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Executive Summary 



The 2004 National Study of Postsecondary Faculty (NSOPF;04), conducted by RTI 
International* (RTI) and sponsored by the U.S. Department of Education’s National Center for 
Education Statistics (NCES), is a nationally representative study that collects data regarding the 
characteristics, workload, and career paths of full- and part-time postsecondary faculty and 
instructional staff at public and private not-for-profit 2- and 4-year institutions in the United 
States. Conducted for the first time in 1988 and again in 1993 and 1999, NSOPE is a major 
source of information about postsecondary faculty in the United States. 

Eor the first time, NSOPE:04 is being conducted as a component study of the 2004 
National Study of Eaculty and Students (NSoEaS;04). The student component — the 2004 
National Postsecondary Student Aid Study (NPSAS:04) — is a nationally representative study of 
student financial aid. Historically, there has been considerable overlap in the institutions 
selected for participation in NSOPE and NPSAS; therefore, institution sampling and contacting 
activities for both studies were coordinated to help minimize response burden on institutions and 
to improve data collection efficiency. 

This report describes the methodology and findings of the NSOPE:04 field test that took 
place during the 2002-03 academic year. The NSOPE:04 field test was used to plan, implement, 
and evaluate methodological procedures, instruments, and systems proposed for use in the full- 
scale study scheduled for the 2003-04 academic year. The field test was particularly important 
in this cycle of NSOPE, because of several changes from prior NSOPE data collections. These 
included 



• the combination of NSOPE and NPSAS into NSoEaS:04, which had important 
implications for the NSOPE:04 institution sample design and institution contacting 
procedures; 

• eliminating the paper self-administered survey mode of response; 

• using integrated web/computer- assisted telephone interviewing (CATI) instruments; 

• shortening the faculty questionnaire; and 

• implementing measures to shorten the data collection period, such as early institution 
contacting and use of incentives for early response. 

This field test methodology report is designed to summarize the findings with regard to 
NSOPE for each of these changes. The methodology and findings of the NPSAS:04 field test are 
provided in a separate report. 



* RTI International is a trade name of Research Triangle Institute. 
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Sample Design 

The NSOFP:04 field test was based on a sample of faeulty and instruetional staff in 
publie and private not-for-profit 2- and 4-year postseeondary institutions throughout the United 
States. A two-stage sampling methodology was used. In the first stage, 150 institutions were 
sampled from the eomplement of the full-seale sample to ensure that no institution would be 
ineluded in both the field test and full-seale studies. While list colleetion was attempted and 
sampling proeessing was eompleted for all institutions sampled in the field test, to aeeommodate 
the short sehedule for the field test, the 150 institutions were subsampled to 75 institutions for 
the seeond-stage sampling of faeulty and instruetional staff. 

The faeulty sample included 1 ,224 part- and full-time faculty and instructional staff 
employed by postseeondary institutions on November 1, 2002. Of these, 27 were determined to 
be ineligible for the study, resulting in 1,197 eligible sample members. 

Instrumentation 

The NSOPF:04 institution questionnaire was designed to be self- administered via the 
Internet. The instrument was divided into major sections that collected information on the 
number of faculty and instructional staff employed at the target institution, the policies and 
practices that affected full-time faculty and instructional staff, the policies and practices 
regarding part-time faculty and instructional staff, and the percentage of undergraduate 
instruction assigned to various instructional personnel. 

The NSOPF:04 faculty instrument was designed as a web-based instrument to be used 
both for self-administration via the Internet and by computer-assisted telephone interviews 
(CATI) for nonresponse follow-up. In addition, a study website was developed for access to the 
self-administered questionnaire and to provide sample members with additional information 
about the study. 

The instrument was designed to accommodate the mixed-mode data collection approach 
and to ensure the collection of high-quality data. Design considerations included appropriate 
question wording for both self-administered and telephone interviews, the provision of extensive 
help text to assist self-administered respondents, and pop-up boxes indicating out-of-range 
values. The instrument consisted of the following eight sections grouped by topic: 

• Employment during the 2003 Fall term (including academic rank, tenure status, and 
field of teaching); 

• Academic and professional background (including highest degree earned and 
employment history); 

• Institutional responsibilities and workload (including instructional activities and other 
work responsibilities performed in a typical week); 

• Scholarly activities (including productivity, funding of scholarly activities, and field 
of research); 
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• Job satisfaction and retirement plans; 

• Monetary eompensation (ineluding ineome from the institution and other sourees, 
structure of the employment eontract, and household ineome); 

• Soeiodemographic information (ineluding gender, raee, date of birth, marital status, 
number of dependent ehildren, and eitizenship); and 

• Opinions about working eonditions at the institution. 

Institution Contacting 

Onee institutions were sampled, attempts were made to eontaet an appointed 
representative of the institution to verify institutional eligibility, solieit partieipation, and request 
the appointment of an Institutional Coordinator to oversee data colleetion within the institution. 
Institutional Coordinators were asked to provide eleetronie lists of all eligible faeulty and 
instruetional staff employed on November 1, 2002, and to eomplete the institution questionnaire. 
By June 2003, of the 149 eligible institutions sampled for the field test, 134 (90 pereent) 
provided faculty lists and 1 14 (77 percent) completed the institution questionnaire. 

Help Desk and Interviewer Training 

Field test training programs were developed for Help Desk operators who would respond 
to questions of sample members attempting to eomplete the web-based survey and for telephone 
interviewers who would eonduet the nonresponse follow-up. Help Desk operators reeeived 
speeifie training in “frequently asked questions” regarding the instrument and teehnieal issues 
related to eompletion of the self-administered questionnaire via the Internet. In addition. Help 
Desk operators received the same training as telephone interviewers because they were expeeted 
to eomplete the instrument over the telephone if requested by a caller. The telephone interviewer 
training foeused on teehniques for sueoessfully loeating and interviewing sample members, and 
eovered sueh topies as administrative proeedures required for ease management, quality eontrol 
of interactions with sample members and other eontaets, the purpose of NSOPF:04 and the uses 
of the NSOPF data, and the organization and operation of the web-based faculty instrument to be 
used in data eolleetion. 

Faculty Locating and Survey Completion 

The NSOPF:04 field test data eolleetion design involved loeating sample members, 
providing an opportunity for them to eomplete the self-administered questionnaire via the 
Internet, following up with web nonrespondents after 3 weeks, and attempting to conduct a 
telephone interview with them. 

Upon reeeipt of faeulty lists, batch locating activities were employed to update addresses 
and telephone numbers. Sourees for this task ineluded the U.S. Postal Serviee’s National 
Change of Address system, Lexis-Nexis, and Telemateh. Faeulty and instruetional staff were 
then mailed a lead letter, information pamphlet, and study ID and password for eompleting the 
questionnaire via the Internet. Telephone eontaet began for self- administered web 
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nonrespondents 3 weeks after the initial mailing. Periodie reminder letters and e-mail messages 
were sent to nonrespondents to eneourage their partieipation. When all telephone numbers for a 
ease were exhausted, the ease underwent intensive traeing. Cases for whieh further eontaeting 
information was obtained were sent baek for eontaet by telephone interviewers; those for whom 
no further eontaeting information eould be obtained were finalized as unloeatable. 

Of the 1,197 eligible sample members, 914 (76 pereent) eompleted the faeulty interview 
during a 5-month field period from late January to late June of 2003. Out of the 914 eompleted 
surveys, a total of 559 (61 pereent) respondents eompleted the self-administered web survey, and 
355 (39 pereent) were interviewed by telephone. The average time to eomplete the survey was 
about 42 minutes. 

Incentive Experiment 

The field test design ineluded an experiment to determine the use of ineentives. The 
experimental design eonsisted of three randomly assigned early-response ineentive groups who 
were offered $0, $20, or $30 to eomplete the self-administered questionnaire over the Internet 
within 3 weeks of the initial mailing and two nonresponse ineentive groups of $0 and $30 for 
those who had not eompleted the survey by a eertain date during data eolleetion. The early- 
response ineentive yielded 31 and 34 pereent response rates for the $20 and $30 ineentives, 
respeetively, eompared with a 16 pereent response rate for the eontrol group. The nonresponse 
ineentive yielded a 47 pereent response rate for those offered $30 and a 34 pereent response rate 
for the eontrol group. The differenees between the treatment and the eontrol groups were 
statistieally signifieant for both phases of the experiment; however, the apparent differenee in 
amounts ($20 versus $30) for the early-response ineentive period, while in the expeeted 
direetion, was not statistieally signifieant. 

Evaluation of Operations and Data Quality 

As noted above, the NSOPF:04 field test was used to plan, implement, and evaluate 
methodologieal proeedures, instruments, and systems proposed for use in the full-seale study; 
therefore, assessments of operations, proeedures, and data quality were eritieal at this stage. 
Evaluations of operations and proeedures foeused on the joint institution eontaeting endeavor, 
the timeline for data eolleetion from both institutions (faeulty lists and institution questionnaires) 
and faeulty (CATI and self-administered interviews), traeing and loeating proeedures, refusal 
eonversion efforts, the effeetiveness of ineentives, and the length of the faeulty interview. 

Results of the data quality evaluations ineluded the following: 

• IPEDS faeulty eounts were often smaller than faeulty eounts obtained from the 
institutional questionnaire or tallied faeulty lists, due to definitional differenees. 
Institution questionnaire and tallied faeulty list eounts were relatively more eonsistent 
with eaeh other. 

• Item nonresponse was below 10 pereent for 81 of the 83 items in the institution 
questionnaire and for 239 out of the 250 items in the faeulty questionnaire. 

• The temporal stability of a subset of items in the faeulty interview was evaluated 
using a reinterview. Of the 26 items evaluated, 15 had pereent agreement over 90 
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percent, 6 had percent agreement between 80 and 90 percent, and 5 had percent 
agreement less than 80 percent. There were no statistically significant modal 
differences in percent agreement for any of these items. 

• Resolution screens proved effective in reducing the amount of inconsistent data 
collected in the faculty instrument. 

• Help text access rates were greater than 10 percent for 9 of the 113 forms (screens) in 
the faculty instrument. These forms were reviewed for problems with wording or 
lack of on-screen information. 

. A recoding of teaching, research, and highest degree coding fields showed 69 percent 
were coded correctly, 21 percent incorrectly and the remaining 10 percent of strings 
were too vague to code. There were no significant modal differences in the coding 
results. 

Data Files 

Data from field tests such as NSOPF:04 are not released to the public; however, all data 
file processing procedures were tested rigorously in preparation for the full-scale effort. 
Procedures tested included a review of instrument editing systems, range and consistency checks 
and data editing. Detailed documentation was also developed to describe question text, response 
options, and recoding. 

Plans for the NSOPF:04 Full-Scale Study 

The final chapter of this report summarizes the changes suggested from the NSOPF:04 
field test. General changes for efficiency and clarity have been suggested for aspects of the 
study such as early institution contacting, instrument programming, tracing and locating, and the 
CATI front-end system. More substantial changes planned for the NSOPF:04 full-scale study 
include the following: 

• Offering incentives to all sample members during the web early-response period and 
during the CATI nonresponse period at the end of data collection. 

• Modifying the institution instrument to make the part-time faculty and instructional 
staff questions parallel with the full-time faculty and instructional staff questions. 

• Shortening the faculty instrument to 30 minutes through the elimination of items, 
refinement of question wording, targeting of help text, and development of an 
autocoding routine for Classification of Instructional Programs (CIP) coding. 

• Beginning faculty data collection as soon as possible in January of 2004, and making 
additional attempts to obtain e-mail addresses of faculty. 
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Foreword 



This report describes the methods and procedures used for the field test data collection 
effort of the 2004 National Study of Postsecondary Faculty (NSOPF:04). NSOPF;04 serves a 
continuing need for data on faculty and instructional staff, all of whom directly affect the quality 
of education in postsecondary institutions. 

We hope that the information provided here and in the full-scale methodology report will 
be useful to a wide range of interested readers and that the results reported in the forthcoming 
full-scale descriptive summary report will encourage others to use the NSOPF:04 data. We 
welcome recommendations for improving the format, content, and approach, so that future 
methodology reports will be more informative and useful. 
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Chapter 1 
Overview of Field Test 



This document describes the study design, procedures, and outcomes for the field test of 
the 2004 National Study of Postsecondary Faculty (NSOPF:04). The field test and subsequent 
full-scale study are being conducted for the National Center for Education Statistics (NCES) of 
the U.S. Department of Education, Washington, DC, as authorized by Title I, Section 153, of the 
Education Sciences Reform Act of 2002 [PE 107-279]. NSOPE:04 is being conducted as a 
component study of the 2004 National Study of Eaculty and Students (NSoEaS:04) under 
contract by RTI International,' with the assistance of MPR Associates, Inc. Eield test results for 
the student component, the 2004 National Postsecondary Student Aid Study (NPSAS:04), are 
provided in a separate methodology report (Charleston et al. 2004). 

This introductory chapter provides an overview of NSOPE, including a description of the 
study, the types of policy-relevant issues addressed, the purpose of the field test, the changes to 
the study from previous cycles, the data and reports generated from the study, and the schedule 
of field test and full-scale data collection activities. 

1.1 Background and Purpose of NSOPF 

NSOPE is a comprehensive nationwide study of the characteristics, workload, and career 
paths of postsecondary faculty and instructional staff.^ The study is based on a nationally 
representative sample of all full- and part-time faculty and instructional staff at public and 
private not-for-profit 2- and 4-year institutions in the United States. The NSOPE: 04 full-scale 
sample will consist of 35,000 faculty and instructional staff selected from about 1,100 sampled 
institutions in the 50 states and the District of Columbia. 

NSOPE:04 will be the fourth cycle of the National Study of Postsecondary Eaculty. 
Previous studies were conducted in 1988, 1993, and 1999 (called NSOPE:88, NSOPE:93, and 
NSOPE:99, respectively). They provided national profiles of faculty and instructional staff in 
postsecondary institutions; national benchmarks for faculty productivity and workload; and 
information on institutional policies and practices that affect faculty. The fourth cycle of the 
National Study of Postsecondary Eaculty, NSOPE:04, will expand the information about faculty 
and instructional staff in two ways: (1) it will allow for comparisons to be made over an 
extended period of time, and (2) it will examine emerging issues concerning faculty such as 
changes related to increased use of the Internet and distance education. 

NSOPE: 04 is designed to address a variety of policy-relevant issues concerning faculty, 
instructional staff, and postsecondary institutions. The study includes faculty and institution 



^ RTI International is a trade name of Research Triangle Institute. 

^ References to “faculty” in this report include instructional staff and others (e.g., administrators) with faculty status 
(who may or may not have instructional duties). 
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questionnaires covering general policies concerning faculty. Information obtained from these 
two sources can answer important questions about postsecondary education, such as the 
following: 

• How many full- and part-time faculty and instructional staff are there? 

• What are their background characteristics? 

• What are their workloads and how is their time allocated between classroom 
instruction and other activities? 

• What are the current teaching practices and uses of technology among postsecondary 
faculty and instructional staff? 

• How satisfied are they with current working conditions and institutional policies? 

• How are faculty and instructional staff compensated by their institutions? How 
important are other sources of income? 

• What are the career and retirement plans of faculty and instructional staff? 

• What retirement packages are available to faculty and instructional staff? 

• Have institutions changed their policies on granting tenure to faculty members? Are 
changes anticipated in the future? 

The following are examples of results from the last cycle (NSOPF:99) (Zimbler 2001): 

• There were about 1 . 1 million faculty and instructional staff in 2- and 4-year 
postsecondary institutions in the Fall of 1998. Approximately 57 percent of faculty 
were employed full time and 43 percent were employed part time by their 
postsecondary institutions. 

• Across all postsecondary institutions, Whites accounted for 84 percent of full-time 
faculty and instructional staff, Asians comprised about 6 percent. Blacks or African 
Americans about 5 percent, Hispanics/Latinos about 3 percent, and American 
Indians/ Alaska Natives about 1 percent in the Fall of 1998. 

• Sixty-four percent of full-time faculty and instructional staff and 52 percent of part- 
time faculty and instructional staff in the Fall of 1998 were men. 

• Full-time instructional faculty and staff spent an average of 1 1 hours a week in the 
classroom in the Fall of 1998. The average number of hours spent teaching classes 
ranged from 7 hours at private research institutions to 17 hours at public 2-year 
institutions. 

• The average base salary for full-time instructional faculty and staff during the 1998 
calendar year was approximately $57,000. The average total income — base salary, 
other institutional income, consulting, and other outside income — was $69,000. For 
part-time instructional faculty and staff, the average base salary was $12,000, and the 
average total income was $46,000, including income from other (perhaps full-time) 
employment. 
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1 .2 Purpose and Major Questions of the Field Test 

The major purposes of the NSOPF:04 field test were to plan, implement, and evaluate 
operational and methodologieal proeedures, instruments, and systems proposed for use in the 
full-seale study. The field test was partieularly important in this eyele of NSOPF, beeause of 
several ehanges from prior years. Perhaps the most important ehange was the deeision of NCES 
to eombine two major studies (NSOPF andNPSAS), previously eonducted independently, into 
one overarehing contract, the 2004 National Study of Faculty and Students (NSoFaS;04). The 
decision was made to combine these studies because historically there has been considerable 
overlap in the institutions selected for participation in NSOPF and NPSAS. Given that each of 
these studies is conducted periodically, NCES decided that they should be combined under one 
contract in order to minimize response burden on institutions and to realize data collection 
efficiencies. However, the NSOPE andNPSAS studies still maintain separate identities and the 
purpose of this report is to summarize only the NSOPE:04 field test. 

The combination of NSOPE and NPSAS into NSoEaS:04 has important implications for 
the NSOPE:04 institution sample design and institution contacting procedures stemming from 
the fact that all NSOPE:04 institutions were also NPSAS institutions. This combination resulted 
in a somewhat larger sample of institutions for the full-scale study than previous NSOPE cycles 
(1,080 compared to 960 in 1999), and in the need to balance the design requirements of both 
studies in all institution-related study procedures. Other changes for NSOPE;04 included: 
eliminating the paper survey mode of response; using integrated web/computer- assisted 
telephone interviewing (CATI) instruments; shortening the faculty questionnaire; and 
implementing measures to shorten the data collection period, such as early institution contacting 
and use of incentives for early response. The major questions addressed in the field test 
correspond to these changes and are listed below. 

• How was the sample design for NSOPE impacted by being combined with NPSAS? 
All NSOPE:04 sampled institutions are also NPSAS institutions (NPSAS has 
additional sampled institutions that are NPSAS-only institutions). 

• What was the effect of combining institution contacting for NSOPE and NPSAS on 
NSOPE list collection? The target was to obtain faculty lists from 90 percent of 
sampled institutions within the timeframe. 

• How did elimination of the paper mode option for NSOPE affect response rates? A 
self-administered paper survey was the major mode of response in previous cycles of 
NSOPE. Eor example, in NSOPE:99, 50 percent of faculty responses were completed 
using a self-administered paper form, 35 percent using a web survey, and 15 percent 
using an abbreviated CATI instrument. The target for NSOPE:04 was to have 50 
percent completed using web mode and 50 percent CATI mode. 

• How well did it work to use a single web-based instrument for both web self- 
administration and CATI? What would be the quality of the data and differences by 
mode of response? 
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• What was the timing for the survey in eaeh mode (web and CATI)? The goal was to 
shorten the length of the faeulty instrument from the 55 minutes in NSOPF:99 to 30 
minutes for NSOPF:04. Beeause of the length of the NSOPF:99 survey, the CATI 
version was abbreviated; however, for NSOPF;04 the web and CATI instruments 
were designed to be identieal. 

• What role did ineentives play in fostering early response before outgoing CATI ealls 
began? What role eould they play in nonresponse follow-up and refusal conversion? 

• How is the faculty response rate affected by data collection strategies for a shortened 
field period? 

The procedure of comprehensive field testing has been used throughout the NSOPF series 
to enhance and advance the methodologies used in these surveys. The evaluations and results of 
the NSOPF:04 field test, described in this report, will inform the design and method of the 
NSOPF:04 full-scale study. 

1.3 Products and Schedule of NSOPF:04 

Data from the full-scale study will be used by researchers and policymakers to examine a 
wide range of topics, including who faculty are, what they do, and whether and how they are 
changing over time. NSOPF provides data on each of these topics. Electronically documented, 
restricted access data files (with associated Electronic Codebooks) as well as NCES’s Data 
Analysis Systems (DASs) and DAS Online (DASOL) for public release will be constructed from 
the full-scale data and distributed to a variety of organizations and researchers. 

The following types of reports are products of NSOPE:04: (1) a full-scale methodology 
report, providing details of sample design and selection procedures, data collection procedures, 
weighting methodologies, estimation procedures and design effects, and the results of 
nonresponse analyses; and (2) a number of descriptive statistical reports. Recent reports have 
been published on topics such as undergraduate teaching, teaching with technology, distance 
education instruction, gender and racial/ethnic composition of the faculty population, tenure 
status, work activities and compensation, and characteristics of part-time faculty. NSOPE 
publications can be accessed electronically through NCES’s website at 
http://nces.ed.gov/pubsearch/getpubcats.asp?sid=01 1 . Special tabulations are available on a 
limited basis upon request, and study findings are presented at conferences. 

Table 1.1 summarizes the data collection schedule for the field test. It also includes the 
proposed data collection schedule for the full-scale study in 2003-04. 

The remainder of this report is organized as follows. Chapter 2 presents an overview of 
the field test design and implementation. Data collection outcomes and the results of the 
incentive experiment are reported in chapter 3. Chapter 4 presents evaluations of the quality of 
data collected from institutions and faculty. Major changes planned for the full-scale study, 
based on field test findings, are summarized in chapter 5. Materials used during the field test 
study are provided as appendices to the report and cited in the text where appropriate. 



NSOPF:04 Field Test Methodology Report 



4 





Chapter 1. Overview of NSOPF:04 



Table 1.1 Schedule of major NSOPF:04 data collection activities 



Activity 


Start date^ 


End date^ 


Field test 






Select institution sample 


5/22/02 


9/10/02 


Make mail and phone contact with Chief Administrator^ 


9/25/02 


6/30/03 


Make mail and phone contact with Institutional Coordinator^ 


10/08/02 


6/30/03 


Obtain lists for faculty sampling"^ 


10/01/02 


6/30/03 


Implement institution questionnaire 


10/01/02 


6/30/03 


Select faculty samples 


11/15/02 


1/30/03 


Send mail and e-mail to faculty 


1/30/03 


6/15/03 


Implement faculty web survey data collection 


1/30/03 


6/30/03 


Implement faculty CATI interviewing 


2/24/03 


6/30/03 


Full-scale study^ 






Select institution sample 


5/22/02 


8/25/02 


Make mail and phone contact with Chief Administrator 


3/10/03 


7/29/04 


Make mail and phone contact with Institutional Coordinator 


3/24/03 


7/29/04 


Obtain lists for faculty sampling 


10/01/03 


6/30/04 


Implement institution questionnaire 


10/01/03 


8/30/04 


Select faculty samples 


11/15/03 


7/10/04 


Send mail and e-mail to faculty 


1/15/04 


8/15/04 


Implement faculty web survey data collection 


1/15/04 


8/30/04 


Implement faculty CATI interviewing 


2/15/04 


8/30/04 



^This is the date on which the activity was initiated for the first applicable institution and/or its associated faculty. 
^This is the date on which the activity was completed for the last applicable institution and/or its associated faculty. 
^Each sampled institution appointed both a Chief Administrator, to be responsible for overall communication and 
institutional participation in the two field tests; and an Institutional Coordinator, who served as the primary point of 
contact to deal with specific survey-related questions, correspondence, and follow-up. 

"^Faculty sampling rates were determined based upon frame counts using IPEDS information, and selected on a 
rolling basis as lists were received. Due to a shorter time frame for the field test than the full-scale study, faculty 
members were selected from the first 75 lists received on a flow basis; however, to test procedures, lists of faculty 
and institution questionnaires continued to be sought and processed from all 150 institutions in the field test sample. 
®The dates for the full-scale study are approximate. 

SOURCE: U.S. Department of Education, National Center for Education Statistics, 2004 National Study of 
Postsecondary Faculty (NSOPF:04) field test. 
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Chapter 2 

Design and Implementation of the Field Test 



This chapter provides a detailed summary of the design and implementation of the 2004 
National Study of Postseeondary Faculty (NSOPF:04) field test. First, the sampling of 
institutions and of faculty and instructional staff is discussed. The sampling discussion is 
followed by a deseription of the ineentive experiment design. Next, the design of the institution 
and faculty data collection instruments is presented. This text is followed by detailed 
deseriptions of the institution and faeulty data eolleetion proeedures. The ehapter eoneludes with 
a deseription of the systems used to facilitate various aspeets of data eolleetion. 

The field test design was discussed with the study’s Teehnieal Review Panel (TRP) 
eomprised of nationally reeognized experts in higher edueation. The list of panel members is 
provided in appendix A. 

2.1 Sampling Design 

In preparation for the fourth administration of the full-scale NSOPF:04, whieh will 
eonsist of a sample of 35,000 faeulty and instruetional staff aeross a sample of about 1,100 
institutions in the 50 states and the Distriet of Columbia, a field test survey of about 1,200 
eligible respondents was earned out in a sample of 150 institutions. Details of the eomposition 
and eonstruetion of the sampling frame, as well as methods used to select institutions and 
individuals for the field test survey, are provided in this seetion. 

2.1.1 Respondent Universe 

This field test survey employed a two-stage sampling methodology; hence, there were 
two sampling frames (universes) from whieh seleetions were made. The first universe eomprised 
all 3,379 eligible institutions, while the seeond universe ineluded all faeulty and instruetional 
staff in the eorresponding institutions, whieh is estimated to inelude approximately 1 . 1 million 
individuals (Zimbler 2001). In order to protect the probabilistie nature of the full-scale sample, 
the field test sample was seleeted from the redueed universe of institutions after seleetion of 
those for the full-seale samples of NSOPF:04 and NPSAS:04. The eomposition and eligibility 
definitions for these universes are outlined below. 

Institution Sample 

The institution universe for the NSOPF:04 (both full-seale study and field test) includes 
the same types of institutions as those ineluded for NSOPF:99. Speoifieally, this universe 

® Faculty sampling rates were determined based upon frame counts using IPEDS information, and selected on a 
rolling basis as lists were received. Due to a shorter time frame for the field test than the full-scale study, faculty 
members were selected from the first 75 lists received on a flow basis; however, to test procedures, lists of faculty 
and institution questionnaires continued to be sought and processed from all 150 institutions in the field test sample. 
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includes Title partieipating publie or private not-for-profit postseeondary institutions that 
provide formal instruetional programs of at least 2 years’ duration designed primarily for 
students who have eompleted the requirements for a high sehool diploma or its equivalent. 

More speeifieally, eligible institutions for the NSOPF:04 field test eonsisted of all 
Title IV postseeondary institutions that 

• were elassified as 2-year publie or private not-for-profit degree- or eertifieate- 
granting institutions, as well as doetoral-granting or other 4-year institutions; 

• offered an edueational program designed for students beyond high sehool; 

• offered programs that were aeademieally, oeeupationally, or voeationally oriented; 

• made programs available to the publie (e.g., ineluding persons other than those 
employed by the institution); and 

• were loeated in the 50 states or the Distriet of Columbia. 

Correspondingly under the above eligibility eriteria, the list of ineligible institutions for 
NSOPF:04 field test ineluded institutions that 

• were not Title IV-eligible; 

• were not degree- or eertifioate-granting; 

• were elassified as operating for profit, or as less-than-2-year institutions; 

• served mainly seeondary students; 

• provided only avoeational, reereational, adult basie edueation, or remedial eourses 
(e.g., danee sehools); 

• provided only in-house business eourses or training; or 

• were serviee (i.e., military) aeademies. 

The institution samples for the full-seale study and field test were seleeted from the 
2000-01 Integrated Postseeondary Edueation Data System (IPEDS) Institutional Charaeteristies 
universe of Title IV partieipating postseeondary institutions. Prior to the sample seleetion, this 
universe of institutions was stratified based on institutional eontrol and level of degree offered. 
Institutional eontrol distinguished between publie and private not-for-profit, while level of 
degree offered used the 2000 Carnegie Classifieation system^ for segmentation of institutions. 



Postseeondary institutions which have signed Title IV participation agreements with the U.S. Department of 
Education are eligible for federal student aid programs. 

® The Carnegie Classification is a taxonomy of colleges and universities in the United States according to such 
variables as degrees awarded, field coverage, and specialization. 
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Table 2.1 summarizes the number of eligible institutions for eaeh of the resulting 10 primary 
strata, based on the Fall 2000 IPEDS eolleetion. 



Table 2.1 NSOPF:04 institution universe, by Carnegie code-based institution type and degree 
granted 



Degree granted 


Total 


Public 


Private (not-for-profit) 


Total 


3,379 


1,697 


1,682 


Doctoraf 


301 


191 


110 


Master’s^ 


591 


271 


320 


Baccalaureate^ 


562 


82 


480 


Associate’s"^ 


1,156 


1,011 


145 


Other/unknown® 


769 


142 


627 



^Includes medical schools. Carnegie Classification codes 15 (Doctoral/Research Universities — Extensive), 16 
(Doctoral/Research Universities — Intensive), and 52 (Specialized Institutions — Medical schools and medical centers). 
^Carnegie Classification codes 21 (Master’s Colleges and Universities I) and 22 (Master’s Colleges and 
Universities II). 

^Carnegie Classification codes 31 (Baccalaureate Colleges — Liberal Arts), 32 (Baccalaureate Colleges — General), 
and 33 (Baccalaureate/Associate’s Colleges). 

"^Carnegie Classification codes 40 (Associate’s Colleges) and 60 (Tribal colleges and universities). 

^Includes all specialized schools except medical, and includes institutions that are not classified by Carnegie. 
Carnegie Classification codes 51 (Specialized Institutions — Theological seminaries and other specialized faith-related 
institutions), 53 (Specialized Institutions — other separate health profession schools), 54 (Specialized Institutions — 
Schools of engineering and technology), 55 (Specialized Institutions — schools of business and management), 56 
(Specialized Institutions — schools of art, music, and design), 57 (Specialized Institutions — schools of law), 58 
(Specialized Institutions — Teachers colleges), and 59 (Specialized Institutions — other specialized institutions). 

NOTE: For sampling purposes, public baccalaureate, private associate’s, and other/unknown institutions were 
collapsed into a single stratum. 

SOURCE: U.S. Department of Education, National Center for Education Statistics, Integrated Postsecondary 
Education Data System (IPEDS), Fall 2000. 



Faculty and Instructional Staff Sample 

The second-stage sampling frame for both the NSOPF:04 field test and the full-scale 
survey includes faculty and instructional staff in the eligible postsecondary institutions. This 
includes both instructional faculty and faculty with no instructional responsibilities (e.g., 
administrative or research faculty) as well as staff with instructional responsibilities regardless of 
faculty status. Eligible individuals for the NSOPF:04 field test included 

• faculty and instructional staff in professional schools (e.g., medical, law, dentistry); 

• faculty and instructional staff who were permanent, temporary, adjunct, visiting, 
acting, or postdoctoral appointees; 

• faculty and instructional staff who were employed full or part time by the institution; 

• faculty and instructional staff who taught classes for credit or noncredit; 

• faculty and instructional staff who were tenured, or nontenured tenure track, or 
nontenured not on tenure track; 
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• faculty and instructional staff who provided individual instruction, served on thesis or 
dissertation committees, advised or otherwise interacted with first-professional, 
graduate, or undergraduate students; 

• faeulty with administrative responsibilities only; and 

• faculty and instructional staff on paid sabbatical leave. 

Under the above eligibility eriteria, the list of ineligible individuals for the NSOPF:04 
field test ineluded the following; 

• graduate or undergraduate teaehing or researeh assistants; 

• faculty and instructional staff on leave without pay; 

• faculty and instructional staff who were not paid by the sampled institution, sueh as 
those in the military or part of a religious order; or 

• faculty and instructional personnel supplied by independent contractors or who 
volunteered their serviees, such as voluntary medical staff. 

2.1.2 Statistical Methodology 

This section first briefly deseribes the sample design for the full-scale study. This is 
beeause after the full-scale sample was determined, a similar methodology was used to seleet the 
needed sample for the field test of NSOPF:04 from those not sampled for partieipation in the 
full-scale study. 

Institution Sampie Aiiocation — Fuii-Scaie Study 

An evaluation of the first cycle of NSOPF (NSOPF:88) revealed that it did not include 
adequate samples of institutions and faeulty members to support all needed analyses, particularly 
those indexed by type of institution. As a result, the sample sizes for the second (1993) and third 
(1999) cycles of NSOPF were inereased in order to seeure suffieient data for analysis by type of 
institution. These cyeles also sampled doetoral-granting institutions with certainty so that all 
institutions in this stratum were included in the NSOPF sample. These adjustments were 
retained for this administration of NSOPF. 
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Another important set of analytieal domains is groups of interest. To aeeommodate this 
analytieal objective, the sample design included securing sufficient sample sizes for different 
groups of interest. The first-stage sample selection used a probability proportional to size (PPS) 
selection methodology, where each institution was assigned a composite measure of size (MOS) 
based on the number of eligible individuals in each of the following groups: 

• Hispanic; 

• non-Hispanic Black or African American; 

• Asian or Pacific Islander; 

• female, full-time employee; and 

• all others. 

Specifically, a measure of size was constructed for each institution to reflect its weighted 
sum of faculty members, where each of the above faculty groups had a slightly different 
sampling rate, with the first four groups overrepresented by a factor of about two times that used 
for the last group. In the interest of reducing standard errors of survey estimates, a constant 
sampling rate was used for each group across all institutions. That is, the MOS for the ith 
institution was given by: 

M05, =Xa^,x/.,/ = 1, ,1,078 

7=1 

where Nij represents the number of faculty members in the y'th group of the ith institution, and fj 
indicates the desired sampling rate for the y'th faculty group. 

Since the staff counts for a number of institutions included those with missing 
race/ethnicity and nonresident aliens, the missing information that was needed for the above 
calculations was imputed. This process involved hot-deck imputation of certain data items, as 
well as prediction of certain other items via regression models. 

In addition, for this administration of NSOPF, attempts were made to employ a more 
efficient sample allocation to further reduce the sampling errors of estimates. For this purpose, a 
customized program was used to identify the optimal sample allocation. The resulting allocation 
of the sample institutions is summarized in table 2.2. 
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Table 2.2 Optimal allocation of the NSOPF:04 full-scale institution sample, by institution type 
and degree granted 



Degree granted 


Total 


Public 


Private (not-for-profit) 


Total 


1,078 


681 


397 


Doctoral 


301 


191 


110 


Master’s 


194 


116 


78 


Baccalaureate 


150 


24 


126 


Associate’s 


324 


313 


11 


Other/unknown 


109 


37 


72 



SOURCE: U.S. Department of Education, National Center for Education Statistics, 2004 National Study of 
Postsecondary Faculty (NSOPF:04) field test. 



Institution Sample Allocation — Field Test Study 

The field test sample was seleeted after the full-scale sample of institutions was selected 
to ensure the probability-based nature of the full-scale sample. To the extent possible, this 
sample was selected following the same design guidelines as those used for selection of the full- 
scale sample. Given that all doctoral-granting institutions were included in the full-scale sample, 
there were no doctoral-granting institutions in the field test sample. To compensate for this, the 
field test sample included additional large master’s degree-granting institutions, as they most 
closely resemble the doctoral-granting institutions in institutional characteristics. A total of 150 
institutions was selected from the main sampling frame after the full-scale NSoFaS sample of 
institutions was removed. This was subsampled to 75 institutions to accommodate time 
constraints and improve efficiency (i.e., too few faculty at institutions is not efficient). The 
distribution of these institutions is summarized in table 2.3. 



Table 2.3 Distribution of the NSOPF:04 field test institutions, by institution type and degree 
granted 



Degree granted 


Total 


Public 


Private (not-for-profit) 


Total 


75 


46 


29 


Doctoral 


0 


0 


0 


Master’s 


23 


12 


11 


Baccalaureate 


16 


2 


14 


Associate’s 


32 


31 


1 


Other/unknown 


4 


1 


3 



NOTE: The starting sample of 150 institutions was subsampled to 75 institutions for sampling faculty. 
SOURCE: U.S. Department of Education, National Center for Education Statistics, 2004 National Study of 
Postsecondary Faculty (NSOPF:04) field test. 



Faculty Sample Allocation 

A list of faculty and instructional staff was requested of the sampled institutions; from 
this list the faculty sample was selected. Due to time constraints for the field test, approximately 
1,200 faculty and instructional staff sampled were selected from a subsample of 75 institutions 
drawn from the field test institutions that sent in lists during the early period of list collection. 
This enabled the field test faculty data collection to commence with the full sample on 
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January 30, a condition that will not be present for the full-scale data eollection. The field test 
list eolleetion and proeessing eontinued for the remaining 75 institutions in the field test sample; 
however, the sampled faculty were not ineluded in the field test data eollection. 

Faculty members were seleeted aeross strata defined by raee/ethnic status, gender, full- 
and part-time status, and program area. For this purpose, it was neeessary to obtain the 
following information for eaeh faeulty member: 

• name; 

• identification (ID) number; 

• diseipline/program area; 

• raee/ethnieity; 

• gender; and 

• part-time/full-time status. 

Faculty ID numbers were used for frame preparations, ineluding removing duplicate 
listings. Moreover, the following faeulty data items were required to assist in data eolleetion 
follow-up aetivities: 

• eampus and home mailing addresses; 

• eampus and home telephone numbers; 

• eellular telephone number; and 

• e-mail address. 

A stratified systematie sampling methodology was used to seleet faeulty and instructional 
staff within selected institutions. Prior to sample seleetion, the list was sorted by program 
area/discipline in each of the main sampling strata: 

• Hispanie; 

• non-Hispanie Blaek or African American; 

• Asian or Pacific Islander; 

• female, full-time employee; and 

• all others. 

The sampling rates depended on the faculty and institutional strata being sampled. These 
rates were ealeulated using the methodology outlined below. 
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NSOPF is a multivariate survey with a /»-dimensional parameter space, 9= {9j),j = 1, 

,p, for which it is desired to estimate ^with 9 while minimizing cost (sample size) subject 

to a series of precision requirements. Consequently, optimal sampling rates can be obtained by 
solving the following nonlinear optimization problem; 

/ f F 

Minimize; C = 

i=i /=i 

v(0)<v,yj 

subject to; < 2 < < N^. , i e [1,1] , 

where 

Co = fixed cost not affected by changes in the numbers of institutions or faculty members 
selected; 

Cii = variable cost per institution, depending on the number of participating institutions in the 
ith institutional stratum; 

«ii = number of participating institutions in the zth stratum; 

C 2 if = variable cost per faculty member, depending on the number of participating faculty 
members in the jih faculty stratum within the zth institutional stratum; and 

zz 2 if = number of participating faculty members in the /th faculty stratum within the zth 
institutional stratum. 

In the above, variance constraints v[9j)< Vj correspond to precision requirements that 

have been specified by NCES for survey estimates. Using data from the NSOPF;99, the needed 
variance components and their associated precision constraints were computed. Using Chromy’s 
algorithm (Chromy 1987), the resulting nonlinear optimization solution to the above cost 
equation C provided the most effective sample allocation. 

2.1.3 Incentive Experiment Design 

As part of the field test study, an experiment was conducted to test a series of hypotheses 
regarding the use of incentives for the NSOPF;04 full-scale study. Specifically, this experiment 
was designed to test the following hypotheses. 

Hypothesis I: Incentives increase the response rate during the initial phase of data collection 

and promote a higher rate of web-based responses. 

Hypothesis II: Incentives increase the completion rate during the nonresponse follow-up 

phase of computer-assisted telephone interviewing (CATI) data collection. 

Hypothesis HI: A higher amount of incentive increases the response rate more than a lower 
amount. 
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The first hypothesis addressed the need for inereasing the number of early responses — a 
byproduct of which could be an increase in the number of web-based interviews. The test of the 
second hypothesis was to assess the effectiveness of incentives as a tool for increasing the 
completion rate, overall and in particular for hard-to-reach faculty and nonrespondents. The 
third hypothesis aimed to determine the opportunity cost of offering different levels of incentives 
for increasing the overall response rate. 

The employed experimental design consisted of three early-response incentive groups — 
ERl ($0), ER2 ($20), and ER3 ($30) — within which two CATI nonresponse follow-up groups of 
NEl ($0) and NE2 ($30) were nested.^ In order to avoid potential issues resulting from offering 
different amounts of incentives to faculty members within a given institution, each institution 
was randomly assigned to one of the six treatment groups when the sample of individuals was 
selected. The randomization process was controlled so that the number of sample members 
assigned to treatment groups was approximately the same during the following three phases of 
the experiment. Details of each stage follow. 



Phase I: 



Phase II: 



Phase III: 



2/1/03 to 2/23/03 - those in groups ER2 and ER3 were offered an incentive to 
complete the questionnaire during the first 3 weeks of the study. Sample 
members were encouraged to respond by web self-administration but were also 
given the option of calling a toll-free number to complete the survey by phone; 

2/24/03 to 4/15/03 - those in all groups were prompted by telephone to 
complete the survey by web self-administration or CATI, during which no 
individual was offered an incentive; and 

4/16/03 to 6/7/03 - those in group NF2 were contacted by telephone and 
offered an incentive to complete the interview by CATI or web self- 
administration. 



Operationally, at the commencement of the experiment, all sample faculty members were 
sent an invitation letter on February 1, asking them to complete the survey by February 23, 2003. 
Those in the first treatment group (ERl) received no initial incentive offer as part of their 
invitation letter, while those in treatment groups ER2 and ER3 were offered $20 and $30 
incentives, respectively, for completing the survey by February 23, 2003. In phase II, 
nonrespondents from the previous phase were contacted by telephone and asked to complete the 
survey without being offered an incentive. At the onset of phase III, all outstanding 
nonrespondents who were pre-assigned to a CATI no-response follow-up incentive group (NF2) 
were offered the $30 incentive to complete the survey, while those in the no-incentive group 



^ The use of incentives in survey research to encourage the participation of nonresponding sample members is a 
well-established data collection procedure that has been reviewed and discussed in considerable detail 
elsewhere (see e.g., Berlin et at 1992; Church 1993; Chromy and Horvitz 1978; Kulka 1992, 1994; Singer et at 
1999; Warriner et at 1996). The payment of incentives to refusals and other nonrespondents provides 
considerable advantages to the government: They provide significant cost savings by reducing telephone costs 
and CATI interviewer time required for repeated contacting attempts and refusal conversion calls, and they limit 
potential nonresponse biases that may result from differential nonresponse of sample cohort members. The 
determination of the incentive level was based on careful review of the methodological literature and prior 
experience with incentives in earlier rounds of the study. The final incentive amounts for the field test incentive 
experiment were developed in consultation with the U.S. Office of Management and Budget (0MB). 
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(NFl) were pursued as before, without an incentive offer. In the final stage of data collection, 
beyond phase III, all remaining faculty members were offered the $30 incentive to secure as 
many completed interviews as possible. This last set of respondents, however, was not included 
in the analysis of the incentive experiment because the experiment design was no longer in 
effect. 



The results of the incentive experiment are reported in section 3.2.5. 

2.2 Instrumentation 

This section describes the institution and faculty instruments that were developed for the 
NSOPF:04 field test and implemented during the 2002-03 academic year with a purposive 
sample of postsecondary institutions and faculty and instructional staff. Data collection for the 
field test was by self-administered questionnaires on the Internet or computer-assisted telephone 
interviews with web nonrespondents. In contrast to the data collection approach for the 1999 
NSOPF, no paper-and-pencil questionnaire options were provided.’ Facsimiles of these two 
electronic instruments, which provide item wordings and response options, are attached to this 
document as appendix B. 

In addition to the self-administered web and CATI questionnaires, a reliability 
reinterview, developed from a subset of items from the complete self-administered and CATI 
questionnaires, was developed to assess the stability of selected questionnaire items. This 
instrument is described in section 4.3.1 of this report. 

2.2.1 Development of Instrumentation 

Project staff from RTI and MPR Associates were responsible, respectively, for 
developing and implementing study instrumentation for the NSOPF:04 field test and for ensuring 
that the instruments retained analytic comparability with earlier data collection rounds of the 
study. Revisions to the institution and faculty/instructional staff instruments built upon the 
NSOPF:99 instruments, and included the comments and suggestions of the TRP, sample 
respondents contacted after the study for additional information, and other government officials 
and postsecondary researchers. Meetings with members of the TRP, government officials, the 
Gallup Organization (the contractor for NSOPF:99), and other interested individuals took place 
before contract award for the NSOPF: 04 study in May 2002. These meetings considered the 
relevance of policy issues examined inNSOPF:99, the importance of additional emerging issues 
(such as increased use of the Internet and distance education) not included in the 1999 
instruments, and the consequences of adding, revising, or deleting items from the NSOPF:99 
instruments.* 

Several policy, methodological, and practical concerns guided the development of 
instrumentation for the NSOPF: 04 field test. To ensure the comparability of data elements from 
earlier rounds of the postsecondary faculty study in 1988, 1993, and 1999, one of the primary 



’ A hard copy “facsimile” of the institution questionnaire was included with the binder materials distributed to 
Institutional Coordinators, but this document was clearly noted to be for information purposes only. 

® For example, one important tool in this process was Developing the 2004 Faculty Survey: Themes from the 
Literature on Postsecondary Education, developed by the American Institutes for Research (Berger et al. 2002). 
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objectives of instrumentation was to maintain the trend analyses possible with this national, 
cross-sectional study. However, this goal was balanced by the importance of adequately 
considering emerging issues, while at the same time developing instruments that could be 
completed quickly and efficiently by sample members. For example, almost 70 percent of the 
institution responses for the 1999 study were obtained via paper-and-pencil questionnaire, and 
the average time to complete the institution questionnaire was 90 minutes. For the NSOPF:99 
faculty questionnaire, over one-half (54 percent) of the respondents completed hardcopy 
instruments, with an average web and paper questionnaire completion time of 5 1 minutes; the 
average CATI completion time was 55 minutes. 

Based on these considerations, the goals for the NSOPF:04 field test instrumentation 
included several elements: 

• All data collection would be completed electronically, using web-based self- 
administered questionnaires, with telephone interviews for those who did not respond 
to the web self-administered questionnaires. 

• All data collection instruments for the field test would be shorter than the NSOPF:99 
instruments, thus simultaneously increasing response rates while reducing the 
potential for bias and the need for costly refusal conversion efforts. The targets for 
average time to complete the instruments were set at 50 minutes for the institution 
questionnaire and 30 minutes for the faculty/instructional staff questionnaire. 

• Consistent with the transition to all-electronic data collection, the NSOPF:04 field test 
instrumentation was designed to be easier for sample members to complete, to be 
easier for the study team to process, and to provide higher-quality data. 

• Finally, the instrumentation team sought to address emerging issues as well as to 
maintain comparability with earlier rounds of the study. 

With these goals established, planning and design for the NSOPF:04 institution and 
faculty/instructional staff questionnaires could begin. Specification for both instruments was in 
RTFs Instrument Development and Documentation System (ID ADS), a tool developed 
specifically for the design of complex electronic data collection instruments (see also section 
2.5.1 below). Using the ID ADS, instrument designers entered information about each instrument 
item, including the variable data definition, formatting, and the desired on-screen presentation.^ 
For each of the NSOPF:04 instruments, designers specified the variable names and labels, values 
and value labels, “applies to” fields, and variable definitions (e.g., numeric, continuous, 
maximum and minimum values, field size). 

2.2.2 Instrument Programming 

Despite the different data collection modes for the NSOPF:04 field test, the self- 
administered web instruments for the institution and faculty/instructional staff respondents were 



® In addition to instrument development, the IDADS also provides a reference system for instrument reviewers and 
testers and serves as the data documentation system for the data products developed by the instruments. 
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identical to their corresponding CATI instruments. Both instruments were web-based products, 
located on U.S. Department of Education servers in Washington, DC. The instruments were 
developed using Microsoft Corporation’s Active Server Pages (ASP) web programming 
language. This approach resulted in a computer-assisted data collection program that facilitated 
the preloading of full-screen data entry and editing of “matrix-type” responses. The web and 
CATI system presented interviewers with screens of questions to be completed, with the 
software guiding the respondent through the interview. Inapplicable questions were skipped 
automatically based on prior response patterns. On-screen clarification and help text were 
available for all items. The instrument also provided real-time error checking for inconsistent or 
out-of-range responses and minimized the potential for inadvertently skipped items. 

2.2.3 Institution Questionnaire 

Instrumentation activities for the NSOPF:04 institution questionnaire began in May 2002 
with revisions to the NSOPF:99 instrument. Project staff began working with a revised version 
of the NSOPF:99 instrument that incorporated the lessons learned from the NSOPF:99 data 
collection, including the comments and suggestions for instrumentation provided by both the 
NSOPF TRP and a small number of study respondents who were contacted for additional 
information after the completion of NSOPF: 99 data collection. After careful consideration of 
this input and examination of the data collected during the 1998-99 academic year — including 
the patterns of responses and missing data, as well as time to complete estimates — instrument 
revisions were implemented. 

Fike the NSOPF:99 institution questionnaire, the NSOPF:04 instrument was divided into 
major sections that collected information on the number of faculty and instructional staff 
employed at the target institution; the policies and practices that affected, respectively, full-time 
and part-time faculty and instructional staff; and the percentage of undergraduate instruction 
assigned to various instructional personnel. Descriptions of the information included in these 
sections follow (see also the instrument facsimile in appendix B): 

• The first section (items 1 A and IB) collected the number of faculty and instructional 
staff employed either full time or part time at the target postsecondary institution 
during the fall term of the target academic year. For NSOPF:04, institution personnel 
were requested to provide these counts “as of November 1, 2002, or during the Fall 
term of the 2002-03 academic year when faculty lists are considered complete for 
that semester or term.” 

• Institution instrument items 2 through 13 defined the second section of the 
questionnaire, and collected information on the employment of the target institution’s 
full-time faculty and instructional staff. After first collecting information on the 
numbers of these personnel who gained or departed full-time employment during the 
previous academic year (2001-02 school year), this section examined the 
characteristics and policies of the target institution’s tenure system, employee 
benefits, collective bargaining, and personnel evaluation. 

Active Server Pages dynamically produce hypertext markup language (HTML) pages designed to facilitate 
information retrieval across the Internet. ASP code includes small embedded programs or scripts that are processed 
on a web server when accessed by users employing browser program such as Netscape or Internet Explorer. Before 
responses are returned to a user, the request typically accesses databases and develops a customized response. 
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• The third section of the institution questionnaire (items 14 through 18) examined the 
employment of the target institution’s part-time faculty and instructional staff This 
section used items similar to those for full-time faculty and instructional staff in the 
previous section. These items included the availability of retirement plans to part- 
time faculty, the availability of and institution-level support for various types of 
employee benefits, and the characteristics of the institution’s personnel evaluation 
system. 

• The fourth instrument section included a single question (19) that collected 
information on the percentage of the target institution’s undergraduate instructional 
activities assigned to all instructional groups, including full-time faculty and 
instructional staff, part-time faculty and instructional staff, teaching assistants such as 
graduate students, and others such as administrators. 

• Finally, the last section of the NSOPF:04 institution questionnaire (20) collected 
respondent contact information and feedback on data collection. This section 
attributed the item responses for the entire institution questionnaire to individual 
respondents at the institution, which allowed data collection staff to recontact 
respondents for clarification of responses. These data elements — respondent name, 
job title, telephone number, and e-mail address — ^were not maintained after data 
collection was completed. 

Appendix C provides a crosswalk of NSOPF:04 institution questionnaire items to the 
institution questionnaires from NSOPF:88, NSOPF:93 and NSOPF:99. Table 2.4 contrasts the 
changes to the NSOPF:04 institution questionnaire that were developed from the institution 
questionnaire employed during 1999. As noted in this table, nine items from the NSOPF:99 
questionnaire were eliminated from the NSOPF:04 field test institution questionnaire, nine items 
were revised, and eight items were repeated for the 1999 field test without change. 
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Table 2.4 Content and formatting changes to the NSOPF:99 institution questionnaire in 
preparation for the NSOPF:04 instrument 





NSOPF:99 






NSOPF:04 


Item 


Content 


Action 


Item 


Chances 


1 


Numbers full/part-time faculty and 
instructional staff 


Revised 


1 


Slight wording and instruction changes 


2 


Change in total number of full-time faculty 
and instruction staff over the past 5 years 


Deleted 






3 


Policies to decrease the number of full-time 
faculty and instructional staff 


Deleted 






4 


Availability of tenure system 


Unchanged 


3 




5 


Changes in full-time faculty and 
instructional staff between fall terms 


Revised 


2 


Cne response option added, but primary 
change was the elimination of tenured, 
tenure track, and untenured distinction 


6 


Number of staff considered/granted tenure 


Unchanged 


4/5 




7 


Maximum number of years on tenure track 


Unchanged 


6 




8 


Changes in tenure policy in past 5 years 


Revised 


7/8 


Dropped response option E from 1 999 


9 


ether actions to reduce tenured faculty 


Deleted 






10 


Number of full-time positions sought to hire 


Unchanged 


9 




11 


Retirement plans available to full-time staff 


Deleted 






12 


Employee benefits available to full-time 
faculty and instructional staff 


Revised 


10 


Response categories for benefits were 
changed to All, Some, and None; fully and 
partially subsidized categories were 
collapsed 


13 


Additional employee benefits available to 
full-time faculty and staff 


Revised 


11 


Response categories for benefits changed 
to All, Some, and None 


14 


Percent of salary contributed by institution 
to benefits 


Deleted 






15 


Collective bargaining 


Unchanged 


12 




16 


Teacher assessment 


Revised 


13 


“ether, specify” response eliminated 


17 


Availability of retirement plans for part-time 
faculty and instructional staff 


Revised 


14 


Item reformatted for web instrument 


18 


Type of retirement plan available for part- 
time faculty and instructional staff 


Deleted 






19 


Criteria for eligibility for retirement plans 


Deleted 






20 


Employee benefits available to part-time 
faculty and instructional staff 


Revised 


15 


Response categories for benefits were 
changed to All, Some, and None; fully and 
partially subsidized categories were 
collapsed 


21 


Additional employee benefits available to 
part-time faculty and staff 


Revised 


16 


Response categories for benefits were 
changed to All, Some, and None 


22 


Eligibility criteria for benefits 


Deleted 






23 


Percent of salary contributed by institution 
to benefits 


Deleted 






24 


Collective bargaining for part-time staff 


Unchanged 


17 




25 


Teacher assessment 


Unchanged 


18 




26 


Undergraduate instruction by instruction 
staff type 


Unchanged 


19 





NOTE: Numbers in table correspond with the question number in the instrument. 

SOURCE: U.S. Department of Education, National Center for Education Statistics, 2004 National Study of 
Postsecondary Faculty (NSOPF:04) field test. 
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2.2.4 Faculty Questionnaire 

The NSOPF:04 field test questionnaire for faeulty and instruetional staff was divided into 
several seetions that described the study and respondents’ rights (informed consent), employment 
characteristics, academic and professional background, workload, scholarly activities, job 
satisfaction, compensation, background characteristics, and opinions. Table 2.5 describes these 
sections, the number of forms (screens) and items included in each, and the types of data 
elements included. Like the instrumentation for the study waves in 1988, 1993, and 1999, 
instrumentation for the study’s faculty and instructional staff emphasized descriptive and 
behavioral attributes rather than attitudinal measures. 



Table 2.5 Overview of the NSOPF:04 field test questionnaire for faculty and instructional staff 



Section 


Forms/ 

items^ 


Content 


Total 


118/260 




Informed consent 


2/0 


Description of the NSCPF:04 study and respondents’ rights as participants. 


A. Nature of employment 


18/19 


Does the respondent have instructional responsibilities during the 2002 Fall 
term? Does the respondent have faculty status? When did the person 
begin working? What is the respondent’s rank, tenure status, and teaching 
field? 


B. Academic/professional 
background 


27/44 


What is the respondent’s highest degree? Where, when, and in what area 
was it earned? Is this the respondent’s first academic job? Where else did 
the person work? Does the respondent teach? Flow long has the person 
been teaching? 


C. Instructional 
responsibilities/ 
workload 


23/112 


Flow many hours during an average week does the sample member spend 
on instruction, research, and other activities? Flow many classes are taught, 
and what are their characteristics (e.g., duration, number/type of students, 
evaluation type)? What types of technology are used? What level of 
advising and individual instruction is offered? 


D. Scholarly activities 


19/31 


What scholarly activities has sample member had in his/her lifetime and 
during past 2 years? What is principal scholarly field? Are scholarly 
activities funded? If yes, by whom and for what amount? 


E. Job satisfaction 


5/11 


Flow satisfied is sample member with instructional duties and employment at 
the target school? What are the person’s retirement plans? 


F. Compensation 


7/15 


What is the respondent’s compensation from the target institution and all 
other sources? What is the structure of the employment contract? What is 
the household income? 


G. Sociodemographic 
characteristics 


11/19 


What is the respondent’s sex, date of birth, race/ethnicity, marital status, 
citizenship, and disability status? Does the person support dependents? 


FI. Cpinions 


3/6 


What are the respondent’s opinions about faculty reward at the target 
institution? Would the sample member seek an academic career again? 


Incentive information 


3/3 


These forms collected information from sample members qualified for 
nonresponse incentives. The information included the type of incentive 
desired (e.g., check or gift certificate) and the postal or e-mail address to be 
used for the incentive. 



'The faculty/instructional staff questionnaire was divided into forms (screens) and items. Each form was structured to 
include related items. The first number is the number of forms, and the second number is the number of items. 
SOURCE: U.S. Department of Education, National Center for Education Statistics, 2004 National Study of 
Postsecondary Faculty (NSOPF:04) field test. 

The design of the field test faculty questionnaire included input from the NSOPF:99 TRP 
and representatives of offices of the Department of Education, as well as an analysis of the data 
collected during the 1999 study. Because the NSOPF:99 instrument was 55 minutes in length. 
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designers made a coneerted effort to shorten the instrument and make it more efficient/^ Several 
questions were eliminated, and other questions were shortened or otherwise simplified. As table 
2.6 demonstrates, 27 items were eliminated from the 1999 instrument, 52 items were simplified 
or otherwise revised, 12 items were added, and 10 items were unehanged. 



Efficiency for the NSOPF:04 instrument was gained by developing a shorter, tighter, and more focused interview 
that used state-of-the-art technology and design techniques. The sections and items were rearranged, coding 
procedures revised considerably to be interactive, skip patterns were employed, range checks were inserted, and 
other changes were implemented to make the instrument operate more efficiently. 
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Table 2.6 Content and formatting changes to the NSOPF:99 faculty questionnaire in preparation 
for the NSOPF:04 instrument 





NSOPF:99 






NSOPF:04 


Item 


Content 


Action 


Item 


Chanqes 


1 


Instructional duties 


Unchanged 


1 




2 


Credit status of instructional duties 


Revised 


2 


Item collected information on whether any 
instructional activities were for credit 


3 


Principal activity 


Revised 


4 


“Other, specify” field removed 


4 


Faculty status 


Unchanged 


3 




5 


Full-time/part-time status 


Unchanged 


5 








New 


6 


Part-time position primary employment 


6 


Preferred part-time/full-time not 


Revised 


8 


Preferred full-time position; eliminated 




available 






reason 






New 


7 


Years employed part-time 


7 


Year began job 


Revised 


9 


Year began at target institution 


8 


Rank 


Revised 


10 


“Other, specify” field eliminated 


9 


Year achieved rank 


Revised 


11 


Stem modified to soecifv at anv institution 


10 


Tenure status/date of tenure 


Revised 


12/13 


Stem modified to specify tenure at any 
institution 


11 


Duration of contract 


Deleted 






12 


Type of appointment 


Deleted 






13 


Chair of department 


Deleted 






14 


Principal field of teaching 


Revised 


16 


Online coding of field used 2000 
Classification of Instructional Programs 
(CIP) 


15 


Principal field of research 


Revised 


54 


Stem wording changed to field of “scholarly 
activities”; online coding utility used CIP 
codes 


16 


Degrees obtained (year received, 


Revised 


MN 


Only the highest degree obtained is 




field, and name, city, state of 




17B/ 


collected; other information collected is 




institution awarding) 




17C 


comparable 






New 


17D 


Year bachelor’s degree awarded; name, 
city, and state of awarding institution 


17 


Working toward a degree 


Deleted 






18 


Degree working toward 


Deleted 






19 


Primary employment 


Deleted 






20 


Outside consulting 


Deleted 






21 


Other professional employment 


Revised 


18 


New item collected information on all 
employment outside of target institution 


22 


Number of other jobs during fall 


Revised 


19A 


Number of jobs expanded to include 




term 




19B 


information on full- and part-time jobs (A) 
outside postsecondary education and (B) at 
other postsecondary institutions 



See notes at end of table. 
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Table 2.6 Content and formatting changes to the NSOPF:99 faculty questionnaire in preparation 
for the NSOPF:04 instrument — Continued 





NSOPF:99 






NSOPF:04 


Item 


Content 


Action 


Item 


Chanqes 






New 


19C 


Number of classes taught at full-time jobs 
and at part-time jobs 






New 


20 


Whether non-postsecondary education jobs 
were related to teaching field 






New 


21 


Whether current job is first postsecondary 
education position 


23 


Total jobs held in postsecondary 
education 


Revised 


22 


Wording changed from higher education to 
postsecondary 


24 


First and most recent jobs in higher 
education: years held, institution 
type, primary responsibility, 
employment status and title 


Revised 


23/24/ 

25/26 


NSOPF:04 field test greatly simplifies this 
question from 18 items to 4. Information 
now is collected on year started, 
employment status, academic rank, and 
tenure status in first position in 
postsecondary education. 


25 


Years teaching in higher education 


Revised 


30 


Wording changed from higher education to 
postsecondary 


26 


Number of positions outside of 
higher education ever held 


Revised 


27 


Changed to whether held positions outside 
postsecondary education 


27 


Job status of those positions 


Deleted 






28 


First and most recent jobs outside of 
higher ed: Type of employer, and 
primary responsibility 


Revised 


28/29 


NSOPF:04 field test greatly simplifies this 
question from 10 items to 2 items. 
Information is now collected on employment 
sector of most recent job and its 
relationship to current principal teaching 
field. 


29 


Scholarly activities during career 


Revised 


52A 


Changes in stem wording and response 
options 


29 


Scholarly activities during past 2 
years, where sole and joint 
responsibility were distinguished 


Revised 


52B 


Distinction between sole and joint 
responsibility of scholarship eliminated 


30 


Average time spent in activities per 
week 


Revised 


31 


“Other, specify” field eliminated 


31 


Allocation of working time, preferred 
allocation of working time 


Revised 


32/33/ 

34 


Preferred allocation eliminated; item 
reformatted for web instrument; response 
categories simplified 


32 


Committee assignments 


Revised 


48 


Information eliminated on the level of 
students served and the number of 
committees chaired and served on 


33 


Number of classes taught 


Revised 


35A 


Item expanded to collect the number of 
classes taught for credit and not for credit 


34 


Number of different courses taught 


Deleted 






35 

36 


Number of remedial classes taught 

Number of noncredit remedial 
classes taught 


Revised 


35B 


Stem wording expanded to collect the 
number of remedial or developmental 
classes taught for credit and not for credit 



See notes at end of table. 
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Table 2.6 Content and formatting changes to the NSOPF:99 faculty questionnaire in preparation 
for the NSOPF:04 instrument — Continued 





NSOPF:99 






NSOPF:04 


Item 


Content 


Action 


Item 


Chances 


37 


Number of continuing education 
classes taught 


Deleted 






38 


Number of noncredit continuing 
education classes taught 


Deleted 






39 


Number of students in all noncredit 
classes 


Deleted 






40 


Number of classes taught for credit 


Revised 


35A 


Stem wording changed to include taught for 
credit toward deqree; item expanded to 
collect the number of classes taught for 
credit and not for credit 


41 


Details on up to five credit classes, 


Revised 


36/37 


NSOPF:04 field test faculty questionnaire 




including the discipline of each 






collected information on up to eight classes. 




class; description (i.e., weeks class 






Information on the classes included weeks 




met, credit hours, hours class 






and hours each week that sample member 




met/week, number teaching 






taught class, credits for the class, number 




assistants, number students, class 






of students, primary level of students in 




team taught, hours per week 






class, and whether teaching/lab assistants 




respondent taught, and remedial 
and/or distance education); level of 
students, instructional method; and 
instructional medium 






were used. 


42 


Undergraduate evaluation methods 


Revised 


38 


Changes in stem wording/response options 


43 


Websites 


Revised 


39 


Changes in stem wording 


44 


Use of websites 


Revised 


40 


Changes in stem wording/response options 


45 


E-mail 


Revised 


41 


Change in stem wording; gate question and 


46 


Student percentage using e-mail 






percentage of students communicating by 
e-mail eliminated 


47 


Hours spent responding to student 
e-mail 








48 


Internet access 


Deleted 










New 


43 


How often, during the 2002 calendar year, 
did sample member meet with faculty to 
plan curriculum, students about career 
plans, business leaders about curriculum or 
student employment? 






New 


44 


Training/professional developed provided 
by institution 






New 


45 


Hours during calendar year spent in training 


49 


Individual instruction 


Revised 


46/47 


Gate question added; stem wording 
changed; item reformatted for web 


50 


Contact hours with advisees 


Unchanged 


50 




51 


Office hours 


Revised 


51 


Stem wording expanded to include in- 
person and online office hours 






New 


53 


Teaching and schooling activities are the 










same 


52 


Engaged in research 


Revised 


55 


Question revised to collect information on 


54 


Engaged in funded research 






whether sample member had funded and/or 
unfunded scholarly activities 


56 


Number supported by grants 


Deleted 







See notes at end of table. 
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Table 2.6 Content and formatting changes to the NSOPF:99 faculty questionnaire in preparation 
for the NSOPF:04 instrument — Continued 





NSOPF:99 






NSOPF:04 


Item 


Content 


Action 


Item 


Chances 


53 


Type of primary research 


Revised 


56 


“Other, specify” field eliminated 


55 


Principal investigator or co-principal 
investigator on funded research 


Deleted 






57 


Sources of funding 


Revised 


58 


Wordina chanced to include orincioal source 
of funding; “other, specify” field eliminated 


58 


Total number of grants 


Revised 


59 


Reference period changed to 2002-03 
academic year 


59a 


Total funds 


Revised 


60 


Stem wording simplified; follow-up screen 
added to address nonresponse 


59b 


How received funds were used 


Deleted 






60 


Evaluation of facilities and 


Deleted 








resources 








61 


Use of institutional funds 


Deleted 






62 


Number and type of administrative 
committees 


Deleted 






63 


Hours spent on administrative 


Revised 


49 


Since NSOPF:99 gate question eliminated. 




committee work 






stem wording changed to include more on- 
screen information 


64 


Union membership 


Revised 


14/15 


Item reformatted for Web instrument 


65 


Satisfaction with instructional duties 


Revised 


61 


Number of response options reduced; new 
options added 


66 


Job satisfaction 


Revised 


62 


Number of response options reduced 


67 


Likelihood of leaving job 


Deleted 






68 


Age to stop working at 
postsecondary institution 


Unchanged 


63 




69 


Factors influencing possible 
decision to leave 


Deleted 






70 


Most important factor regarding 
decision 


Deleted 






71 


Option to draw on retirement 


Deleted 






72 


Retired previously 


Unchanged 


64 




73 


Early retirement option 


Deleted 






74 


Age planning to retire 


Unchanged 


65 




75b 


Basis of basic salary 


Revised 


67/68/ 


Expanded to collection information on 


75a 


Basic salary for academic year 




69 


contract length and other pay arrangements 


76 


Compensation for calendar year 


Revised 


66A 


Response categories for item were combined 
and streamlined to encourage easier 
response from sample members 






New 


66B 


Follow-up screen developed for those unable 
or unwilling to respond to 66A 


77 


Income of spouse/significant other 


Deleted 






78 


Number of persons in household 


Deleted 






79 


Household income 


Revised 


70 


Definition of household income added; 
follow-up screen addressing nonresponse 
added 



See notes at end of table. 
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Table 2.6 Content and formatting changes to the NSOPF:99 faculty questionnaire in preparation 
for the NSOPF:04 instrument — Continued 





NSOPF:99 






NSOPF:04 


Item 


Content 


Action 


Item 


Chances 


80 


Number of dependents 


Unchanged 


78 


Number of dependents 






New 


79 


Number of dependent children 


81 


Gender 


Unchanged 


71 




82 


Month and year of birth 


Revised 


72 


Birth month eliminated 


83 


Ethnicity 


Revised 


73 


Reformatted for web instrument 


84 


Race 


Revised 


74 


Response options reordered to match current 
race/ethnicity data collection standards 


85 


Disability 


Revised 


75 


Stem wording revised to include additional 
on-screen definitions 


86 


Type of disability 


Unchanged 


76 




87 


Marital status 


Revised 


77 


Response options reordered 


88 


Employment of spouse/significant 
other 


Deleted 






89 


Country of birth 


Revised 


80 


Revised to ask born in the United States only 


90 


Citizenship status 


Revised 


81 


Visa status and distinction between 
native/naturalized citizenship eliminated 


91 


Parent and spouse education level 


Deleted 






92 


Opinions about target institution 


Revised 


82/83 


Number of response options reduced; new 


93 


Opinions about working conditions 






options added 



NOTE: Numbers in table correspond with the question number in the instrument. Some numbers (42, 57) are 
missing from the NSOPF:04 instrument because they were deleted during instrument design. 

SOURCE: U.S. Department of Education, National Center for Education Statistics, 2004 National Study of 
Postsecondary Faculty (NSOPF:04) field test. 

2.3 Institution Data Collection 

The goals of the institution data collection for the NSOPF study were to collect a list of 
full- and part-time faculty and instructional staff (referred to as a “faculty list”) from each 
sampled institution and to obtain a completed questionnaire from each sampled institution.'^ As 
described in section 2.1.2, the faculty list was used for selecting the faculty sample and also 
provided the contact information used for faculty data collection activities. The institution 
questionnaire, detailed in section 2.2.3, collected information on the policies and practices 
affecting full- and part-time faculty and instructional staff. To facilitate the process of obtaining 
faculty lists and completing the institution questionnaire, an institution website was developed, 
and for each sampled institution a Chief Administrator was appointed. 

2.3.1 Institution Website 

The NSoFaS website served a number of functions for both the NSOPF and NPSAS field 
tests. For institutions, it was a central repository for all study documents. It housed a 
questionnaire for institutions to complete online (the “institution questionnaire”). It also 
provided for the uploading of electronic lists of faculty and instructional staff. Figure 2.1 
presents the home page of the field test NSoFaS website. 



In addition, a list of students was requested of each institution for the NPSAS study. 
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Figure 2.1 The 2004 National Study of Faculty and Students institution website home page 
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SOURCE: U.S. Department of Education, National Center for Education Statistics, 2004 National Study of Faculty 
and Students (NSoFaS:04) website. 



Visitors to the website were provided with the following links (see navigation bar on the 
left side of the sereen): 

• About NSOPF (Faeulty) provided sueeinet information on the study’s mandate and 
researeh objeetives, with a link to National Center for Edueation Statisties (NCES) 
reports from previous study eyeles. 

• About NPSAS (Student) provided eomparable information for the student eomponent 
ofNSoEaS. 

• Endorsements listed the 25 national organizations that endorsed the studies. (These 
are listed in the pamphlet eontained in appendix D.) 

• Frequently Asked Questions (FAQs) ineluded questions and answers eoneerning all 
stages of data eolleetion for both eomponents of NSoEaS. 

• Help provided the help desk toll-free number and e-mail address for eontaeting 
projeet staff, along with instruetions for logging in. 

• Contact Us eontained address information for RTI International. 
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• Login provided fields for entering a username and password, giving aecess to all data 
eollection pages (i.e., the institution questionnaire for them to eomplete; and the list 
of faculty and instructional staff employed by their institution, which they were to 
upload). 



All data entry applications were protected by Secure Socket Layer (SSL) encryption. 
Further security was provided by an automatic “time out” feature, through which a user was 
automatically logged out of the NSOPF institution questionnaire if the system was idle for 30 
minutes or longer. The system did not use any persistent “cookies,”'^ thus adhering to the 
Department of Education’s privacy policy. 

A status screen, shown in figure 2.2, indicated which stages of institution data collection 
were completed (denoted by a check mark) and allowed institutions to select those stages that 
were not yet completed. Once a stage was completed, it was no longer accessible via the web. 



Figure 2.2 The 2004 National Study of Faculty and Students institution website status screen 
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Source: U.S. Department of Education, National Center for Education Statistics, 2004 National Study of Faculty and 



Students (NSoFaS:04) website. 



A persistent “cookie” is a piece of information, such as an IPEDS ID, that can be stored in a file on the user’s 
computer. This information could then be used to identify a computer without the user even logging into the 
application. 
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2.3.2 Institution Contacting 

The institution sample for the field test of the 2004 National Study of Faculty and 
Students consisted of 200 institutions, of which 150 were sampled for NSOPF as well as 
NPSAS. These 150 institutions were recruited to participate in both components of NSoFaS 
(NSOPF and NPSAS). 

In order to increase the likelihood of institutional participation, endorsements from 
relevant organizations that had previously endorsed NSOPF and/or NPSAS were renewed and 
extended, as appropriate, to both NSoFaS component studies. An effort was also made to solicit 
new endorsements from other organizations as it was deemed helpful. In all, 25 organizations 
endorsed NSoFaS.'"^ 

The effort to recruit institutions began with a telephone call to each sampled institution to 
verify the address of the institution, confirm eligibility for the sample (as appropriate), and 
collect contact information from the Chief Administrator (CA).'^ 

CAs at institutions sampled for NSoFaS were sent the following materials. Copies of 
letters and pamphlets sent to CAs and Institutional Coordinators can be found in appendix D. 

• A cover letter, printed on NCES letterhead, provided background information on 
NSOPF and NPSAS. The letter requested that the CA designate the Institutional 
Coordinator for both components of the study via an online “Designation of 
Coordinator” form. The letter provided the IPEDS unit ID,'^ password and URL 
(web address) necessary to access the online form. 

• An NSoEaS pamphlet summarized the objectives of both NPSAS and NSOPE, and 
provided background information and selected findings for each component. 

• An NSOPE pamphlet summarizing the NSOPE study was included to show what 
would be mailed to the sampled faculty. 

• A NPSAS pamphlet summarizing the NPSAS study was included to show what 
would be mailed to sampled students. 

A team of four institutional contactors followed up with the CAs by telephone. The CAs 
were asked to name an Institutional Coordinator (IC) by completing the “Designation of 
Coordinator” form online, or providing the information over the telephone. 

Mailings containing instructions for participation in both NSOPE and NPSAS were sent 
to ICs on a flow basis as the ICs were designated by the CA. The mailing, which was packaged 
in a three-ring binder, included the following materials: 



One of these organizations, associated with for-profit schools, was asked only for an endorsement for NPSAS. 

Each sampled institution appointed both a Chief Administrator, who was responsible for overall communication and 
institutional participation in the two field tests; and an Institutional Coordinator, who served as the primary point of 
contact to deal with specific survey-related questions, correspondence, and follow-up. 

Chief Administrators and Institutional Coordinators used their institution IPEDS unit ID and a password to 
authenticate to the institution website. Faculty and instructional staff were assigned a study ID and password to 
authenticate to the faculty website. 



NSOPF:04 Field Test Methodology Report 



30 






Chapter 2. Design and Implementation of the Field Test 



• a cover letter deseribing the study, the institution’s password, IPEDS unit ID, and 
web address neeessary to aeeess the NSOFAS website (a separate letter was ereated 
for NPSAS-only sampled institutions); 

• a eopy of the letter that went to the CA, and a faesimile of the “Designation of 
Coordinator” form; 

• a listing of endorsements, and a eopy of the endorsement letter from the National 
Assoeiation of Financial Aid Administrators; 

• a schedule of aetivities, ineluding a flowohart of NSoFaS aetivities; 

• a faesimile of the institution questionnaire, along with instruetions for its eompletion 
on the web; 

• instruetions for preparing the list of faculty and instructional staff, including a list of 
data elements requested, and a suggested fde layout; 

• complete instruetions for participation in each phase of NSoFaS; and 

• a list of transmittal options for sending faeulty lists, by mail, e-mail, and direet upload 
to the NSoFaS website, together with an express eourier paeket and label for mailing 
the lists if required. 

Faculty List Collection Procedures 

The instruetions direeted the ICs to provide a list of full- and part-time faeulty and 
instructional staff, including all personnel who had faeulty status or any instructional 
responsibilities during the 2002 Fall term. Institutions were eneouraged to submit an eleetronie 
list by uploading it to the seeure website. The data items requested for eaeh listed faculty or 
instructional staff member were as follows; 

• full name; 

• aeademie discipline; 

• department/program affiliation; 

• full-time/part-time status; 

• gender; 

• raee/ethnicity; 

• employee ID number (to eliminate duplieates from sample); and 

• contact information — institution and home mailing address, institution and home 
e-mail address (if available), and home and campus telephone numbers. 

Follow-up with ICs was conducted by telephone, mail, and e-mail. Telephone prompts to 
the ICs were made for institutions that had not provided lists. To minimize the number of 
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contacts made to an IC, prompting for NSOPF was combined with prompting for NPSAS. Two 
e-mail prompts were sent to ICs, eneouraging them to review projeet materials available on the 
NSoFaS website, and alerting them to approaehing deadlines. E-mail prompts were timed to 
preeede project deadlines, and foeused on timely completion of requested materials. As faculty 
lists were reeeived, they were reviewed for eompleteness, readability, and aeeuraey. 

Institution Questionnaire Collection Procedures 

ICs were asked to eomplete the institution questionnaire (deseribed in seetion 2.2.3) 
online using the study’s institution website. Institution questionnaire follow-up was eonducted 
simultaneously with follow-up for lists of faeulty. If an institution was unable to eomplete the 
questionnaire online, efforts were made to eolleet the information over the telephone. This often 
involved eontaeting multiple offiees within the institution, as questions about benefits and tenure 
polieies eould most frequently be completed by human resourees, while questions about faeulty 
eounts were typieally answered by institutional researeh staff. 

Counts of full- and part-time faeulty were eolleeted in both the institution questionnaire 
and in the faeulty lists. For eaeh institution, the eounts of full- and part-time faeulty were 
eheeked against those provided in the institution questionnaire and against 2001 IPEDS Eall 
Staff Survey data. IPEDS data were used for diserepaney eheeks whenever institution 
questionnaire data were unavailable but also served as an additional eheek to eateh inaoeuraeies 
in matching questionnaire/list data that otherwise would not have been diseovered. Details of 
diserepancies in eounts of full- and part-time faculty are provided in seetion 4.1. 

Administrative Systems and Procedures 

To effieiently traek all mail and telephone follow-up (both ineoming and outgoing) and 
proeessing and sampling aetivities, the study utilized an Institutional Contaeting System (ICS) 
specifieally designed to meet the needs of the NSoEaS projeet. The ICS was aceessible to 
eontaetors, eall eenter^’ supervisors, and projeet staff. The NSoEaS ICS was designed so that a 
ehange in status (for example, a eompleted “Designation of Coordinator” form) automatieally 
generated the next step (a mailout to the Institutional Coordinator and an automatic appointment 
for telephone follow-up). Eleetronic eall notes doeumented the outcome of every eonversation. 
The system allowed interviewers to set appointments for future follow-up. Through the ICS, the 
interviewer had the ability to designate an Institutional Coordinator, provide eontaet information 
and aeeess the institution questionnaire and other data eollection instruments. The ICS gave 
interviewers the ability to generate an automatic e-mail to Institutional Coordinators eontaining 
the password and IPEDS unit ID required for aeeess. A “problem report form” feature of the 
ICS allowed institutional eontaetors to immediately forward speeifie eall notes to an e-mail box 
monitored by projeet staff. This ensured that refusals, requests for remails, and ealls requiring 
follow-up by projeet staff were handled promptly. 

Quality Cirele meetings, attended by interviewers, supervisors, team leaders, and projeet 
staff, were held on a weekly basis to share ideas for gaining institutional eooperation and 
suggestions for improving proeedures. Projeet staff solicited feedbaek from eall eenter personnel 



RTI’s Call Center Services provides telephone, web, and tracing services for a wide variety of projects, and 
operates two call centers: one in Raleigh, NC, and one in Greenville, NC. 
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on the ICS, scripts, and handling problems reported by respondents (e.g., difficulties accessing 
the website). 

2.4 Faculty Data Collection 

The NSOPF:04 field test utilized a mixed-mode data collection methodology, beginning 
with a mailing to respondents that gave them instructions for completing the survey by web- 
based self-administration. The mailing also provided a toll-free number to call if they preferred 
to complete the survey by telephone. After an initial period, outgoing CATI calls were made to 
sample members. The self-administered web instrument remained available to respondents 
throughout data collection. As described in section 2.1.3, an early-response incentive was 
offered to a portion of the field test sample as part of an experiment designed to encourage 
sample members to complete the self-administered web questionnaire prior to outgoing CATI 
calls. A nonresponse follow-up incentive was also offered to selected sample members based on 
their experimental group. 

2.4.1 Faculty Website 

The website for the NSOPF;04 field test served a dual purpose. The primary function 
was to provide access to the web questionnaire for the sampled faculty and instructional staff. 
The secondary function was to provide information, including background information about the 
study, the selected sample, the sponsor, the contractor, and confidentiality assurances. In 
addition to the information available on the site, links were provided to other relevant sites (e.g., 
NCES). The home page of the NSOPF:04 field test website is depicted in figure 2.3. 

The initial login page provided the link to the web instrument. The login process 
involved entering a specific study ID and password, which were provided to the respondent in 
the lead letter. Respondents could also obtain their study ID and password by e-mailing the 
project, or by contacting a help desk agent at the NSOPF toll-free number. 

As with the institution application, the web instrument was protected by SSL encryption, 
an automatic “time out” feature, and omission of any persistent “cookies.” 

2.4.2 Incentive Experiment Implementation 

As explained earlier in this chapter, the NSOPF:04 incentive experiment was intended to 
measure improvements to response rates when the incentives were systematically implemented. 
Before data collection began, sample members were assigned to one of three treatment groups 
(none, $20, or $30 incentive) for the early-response incentive (web self-administered or call-in 
using the toll-free number), and one of two treatment groups (none or $30) for the refusal 
conversion/nonresponse incentive. To avoid potential research threats from treatment diffusion 
or rivalry, all individuals within an institution were offered the same level of incentive. 

For sample members who were selected for the early-response incentive, explanatory 
materials about the incentive were provided in the lead-letter packet. In addition to the mention 
of the incentive in the initial lead letter, a number of follow-up reminder letters and e-mails were 
sent to alert the respondents of deadlines for incentive eligibility. 
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Figure 2.3 The 2004 NSOPF faculty website home page 
E1S 







-\ 







SOURCE: U.S. Department of Education, National Center for Education Statistics, 2004 National Study of 
Postsecondary Faculty (NSOPF:04) website. 



Once the early-response ineentive period expired, all remaining eases reverted to 
nonineentive status. In this second phase of the experiment, during which no incentives were 
offered, those who had not yet eompleted an interview were contacted by telephone. During the 
third and final phase of the incentive experiment, telephone-eontaeted sample members who 
refused to eomplete the interview and individuals who were identified as diffieult to eontaet (i.e., 
no telephone number was available) were offered the nonresponse incentive if selected for the 
incentive treatment group. This ineentive treatment was independent of the early-response 
ineentive treatment; respondents were not neeessarily offered the same ineentive amount for 
nonresponse follow-up as they were for early-response ineentives. In the final month of data 
eolleetion, all oases were offered the nonresponse ineentive (but excluded from ineentive 
experiment analyses) in order to boost response rates. 

2.4.3 Locating and Interviewing Procedures 

The NSOPF:04 faculty data collection design involved looating sample members, 
providing an opportunity for the faoulty or instruotional staff to eomplete the self-administered 
questionnaire via the web, and following up web nonrespondents after 314 weeks to eonduet a 
eomputer-assisted telephone interview. The data eolleetion period for the field test lasted 5 
months (January 30 through June 30, 2003). Data eolleetion aetivities for faoulty are shown in 
figure 2.4. 
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Figure 2.4 NSOPF:04 field test faculty data collection overview 




^If a home address was available for the sample member, the lead letter package was mailed to the home. If there 
was no home address, the package was mailed to the school address. If there was no specific school address 
available, the package was mailed to the main address on file for the school. 

^The web interview option was available throughout data collection, even after telephone follow-up began. 

^The sample member’s office and home telephone numbers were called by CATI interviewers. If no specific 
telephone number was available for the sample member, the school’s main telephone number was used. 
SOURCE: U.S. Department of Education, National Center for Education Statistics, 2004 National Study of 
Postsecondary Faculty (NSOPF:04) field test. 
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Mailouts 

Faculty and instructional staff were sent a lead letter, instruetions for the web 
instrument, and a study pamphlet. (Examples of these materials are ineluded in appendix D.) 
The lead letter introdueed the study and listed the organizations that endorsed the study. Both 
the lead letter and the instruetional insert provided the information required to aeeess the 
questionnaire via the web. 

Periodieally throughout the data eollection period, reminder letters and e-mail messages 
were sent to nonrespondents to eneourage their partieipation and to notify them of the ineentive, 
if applieable. Examples of these follow-up eontacts are ineluded in appendix D. 

Locating 

While faeulty and instructional staff sampled from known institutions tend to be more 
easily loeated than some other sample populations, sueh as students, loeating eaeh sample 
member was eritieal to the sueeess of the NSOPE:04 field test. Eoeating aetivities were 
eondueted in two stages: advanee traeing (bateh searehes, whieh took plaee before data 
eolleetion began) and intensive traeing (interaetive traeing conducted during data eolleetion). 

Advance tracing. Elpon receipt of faculty lists from participating institutions, batch 
locating activities were employed to update home address and telephone information for the 
sampled faculty and instructional staff. The following databases were used for these searches: 

• National Change of Address (NCOA) - a database consisting of change of address 
data submitted to the U.S. Postal Service and updated every 2 weeks with records 
stored for 18 months. Cases with home address information were sent to NCOA to 
search for any updated home address information. 

• Eexis-Nexis - a vendor specializing in database management, including credit header 
information that contains address and other contact information. The most recent 
home address (obtained either from the institution or the NCOA search) was provided 
to Eexis-Nexis for an address and telephone number search. 

• Telematch - a computerized residential telephone number look-up service consisting 
of over 65 million listings, over 1 million not-yet-published numbers of new movers, 
and over 10 million businesses. Telematch used all home addresses and telephone 
numbers for a sample member (obtained from the institution, NCOA, and Eexis- 
Nexis) to search for updated home telephone numbers. 

In some cases, the database searches confirmed or updated the contact information provided by 
the institution; in other cases, the searches resulted in new contact information. All locating 
information obtained as a result of these searches was loaded into the NSOPE:04 database. 



Respondents were also given the option of calling a toll-free number to complete the survey by telephone. 

Only cases with home contact information were sent for batch database searches because office contact 
information is not available through these sources. Home contact information was not available for some sample 
members. If needed, experienced tracers searched for office contact information during the intensive tracing stage. 
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Intensive tracing. Intensive traeing was performed on a ease if the case had no 
telephone number for loading in CATI, or the case was designated as a dead end in CATI (i.e., 
there were no more telephone numbers to call for the case). The following steps were performed 
by the tracing unit to locate sample members. 

• Check the preloaded information using an online directory assistance search. This 
step was intended to identify the easy-to-locate cases (for example, a case might have 
the correct telephone number but the wrong area code). 

• Conduct credit bureau database searches. The tracing unit had access to various 
proprietary databases (TransUnion, Equifax, and Experian) containing current address 
and phone listings for the majority of consumers with a credit history. 

• Conduct additional intensive tracing. This step included (but was not limited to) 
searches using Eexis-Nexis and EastData, directory assistance calls, and searches of 
institution websites for campus directories. 

Tracing staff checked all new leads procured during their tracing efforts to confirm the 
addresses and telephone numbers that were obtained. When a telephone number for a sample 
member was confirmed, the case was returned to CATI for telephone interviewing. Cases with 
new address information were mailed a lead-letter packet. If the tracing unit located a new e- 
mail address for a sample member, the information was loaded into the database for future e-mail 
mailings to nonrespondents. 

Staff Training 

The mixed-mode design of the NSOPE:04 field test data collection required the 
development of three separate training programs for data collectors: help desk training, CATI 
interviewer training, and tracing. In addition, separate training sessions were conducted for 
supervisors. 

At the outset of each of the training sessions, each staff member received a detailed 
NSOPE:04 interviewer manual that served as both an instruction guide for the training lectures, 
discussions, and practical exercises, and as a reference guide for use after completion of training. 
Supervisors, monitors, and help desk agents received supplemental chapters in their manuals. 

The manual’s table of contents and a sample of the agenda for telephone interviewer training are 
included in appendix E. 

Common to each training session was a study overview, a review of the confidentiality 
requirements, a demonstration interview, an in-depth review of the instrument, hands-on practice 
exercises with the instrument, and open-ended coding modules. The help desk and CATI 
telephone training sessions were customized as follows: 

• Help desk agents reviewed the “frequently asked questions” in detail, including 
responses to instrument-specific questions as well as technical issues, and instructions 
for documenting each call to the study hotline. 
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• Telephone interviewers were trained in techniques for gaining cooperation of sample 
members, and of other contacts, as well as techniques for addressing the concerns of 
reluctant participants and for avoiding refusals. 

Self-Administered Questionnaires 

The first phase of data collection, lasting 314 weeks after the lead letters were mailed, 
provided an opportunity for respondents to complete the self-administered questionnaire via the 
web before the telephone follow-up calls began. The web interview site remained available 24 
hours a day, 7 days a week, thereby giving sample members the option to complete the 
questionnaire online during the entire 5 months of data collection. 

Help Desk Operations 

The NSOPF help desk opened on January 31, 2003, in anticipation of the first respondent 
calls after the lead-letter mailing. The help desk staff were available to assist sample members 
who had questions or problems accessing and completing the self-administered questionnaire. A 
toll-free hotline was set up to accept incoming help desk calls. If technical difficulties prevented 
a sample member from completing the self-administered questionnaire, a help desk staff 
member, also trained to conduct telephone interviews, would encourage the caller to complete a 
telephone interview rather than to attempt the self-administered questionnaire. 

All incoming calls from sample members were documented using the help desk software. 
In addition to this primary documentation function, the software provided 

• information needed to verify a sample member’s identity, 

• login information (study ID and password) for the web questionnaire, and 

• a means for tracking calls that could not be resolved immediately. 

The help desk software also provided project staff with reports on the types and 
frequency of problems experienced by sample members, as well as a way to monitor the 
resolution status of all help desk inquiries. 

Telephone Interviewing 

Telephone prompts to nonrespondents began on February 24, 2003, at the end of the 
early-response incentive period. CATI procedures included attempts to locate, gain cooperation 
from, and interview study sample members who had not completed the questionnaire online. 
Interviewers encouraged respondents to complete the interview by telephone as soon as they 
made contact. However, if the sample member expressed a preference for completing the self- 
administered questionnaire via the web, a callback was scheduled for 1 week later. During these 
callbacks, interviewers again prompted the faculty members to complete the questionnaire by 
telephone. 
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Refusal conversion procedures were used to gain cooperation from individuals who 
refused to complete the field test questionnaire. When a refusal was first encountered, either 
because the sample member refused or because a “gatekeeper” (secretary or spouse) refused on 
behalf of the sample member, the case was referred to a refusal conversion specialist. Refusal 
conversion specialists were selected from among those interviewers most skilled at obtaining 
cooperation and were given training in refusal conversion techniques tailored to NSOPF. The 
refusal training emphasized ways to gain cooperation, overcome objections, address the concerns 
of gatekeepers, and encourage participation. 

2.5 Data Collection Systems 

2.5.1 Instrument Design and Documentation System 

The Instrument Design and Documentation System (ID ADS) is a controlled web 
environment in which project staff developed, reviewed, modified, and communicated changes 
to specifications, code, and documentation for the NSOPF;04 instrument. All information 
relating to the NSOPF:04 instrument was stored in a Structured Query Language (SQL) Server 
database and was made accessible through Windows and web interfaces. There are three 
modules within ID ADS: specifications, programming, and documentation. 

Initial specifications were generated within the ID ADS specification module. This 
module enabled access for searching, reviewing, commenting on, updating, exporting, and 
importing information associated with instrument development. All records were maintained 
individually for each item, which provided a historical account of all changes requested by both 
project staff and NCES. 

Once specifications were finalized, the programming module within ID ADS produced 
hypertext transfer markup language (HTML), Active Server Pages (ASP), and JavaScript 
template program code for each screen based on the contents of the SQL Server database. This 
output included screen wording, response options, and code to write the responses to a database, 
as well as code to automatically handle such web instrument functions as backing up and moving 
forward, recording timer data, and linking to context-specific help text. Programming staff 
edited the automatically generated code to customize screen appearance and program response- 
based routing. 

The documentation module contained the finalized version of all instrument items, their 
screen wording, and variable and value labels. Also included were the more technical 
descriptions of items such as variable types (alpha or numeric), information regarding to whom 
the item was administered, and frequency distributions for response categories. The 
documentation module was used to generate the instrument facsimiles and the Electronic 
Codebook (ECB) input files. 

2.5.2 Integrated Management System 

All aspects of the field test were under the control of an Integrated Management System 
(IMS), which was employed for the field test and remains in use for the full-scale study. The 
IMS is a comprehensive set of desktop tools designed to give project staff and NCES access to a 
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centralized, easily aecessible repository for project data and documents. The NSOPF:04 IMS 
eonsists of three eomponents: the management module, the Reeeipt Control System (RCS), and 
the Case Management System (CMS). 

The management module of the IMS eontains tools and strategies to assist projeet staff 
and the NCES project officer in managing the study. All information pertinent to the study is 
loeated there, aeeessible via the web, in a seeure desktop environment. Available on the IMS are 
the eurrent projeet schedule, monthly progress reports, daily data colleetion reports and status 
reports (available through the Receipt Control System deseribed below), projeet plans and 
speeffieations, projeet information and deliverables, instrument speeffieations, staff eontacts, the 
projeet bibliography, and a doeument arehive. The IMS management module also has a 
download area from whieh the elient and subeontractors ean retrieve large files when neeessary. 

The Receipt Control System (RCS) is an integrated set of systems that monitors all 
aetivities related to data oolleetion, ineluding tracing and locating. Through the RCS, projeet 
staff are able to perform stage-speeifie aetivities, traek ease statuses, identify problems early, and 
implement solutions effectively. RCS loeator data are used for a number of daily tasks related to 
sample maintenanee. Speeifieally, the mailout program produees mailings to sample members, 
the query system enables administrators to review the loeator information and status for a 
partieular ease, and the mail return system enables projeet staff to update the loeator database. 
The RCS also interacts with the Case Management System and traeing unit databases, sending 
loeator data among the three systems as neeessary. 

The Case Management System (CMS) is the teehnologieal infrastrueture that eonneets the 
various eomponents of the CATI system, ineluding the questionnaire, utility sereens, databases, 
eall scheduler, report modules, links to outside systems, and other system eomponents. The eall 
seheduler assigns eases to interviewers in a predefined priority order. In addition to delivering 
appointments to interviewers at the appropriate time, the eall seheduler also ealeulates the 
priority scores (the order in whieh eases need to be ealled based on preprogrammed rules), sorts 
oases in non-appointment queues, and computes time zone adjustments to ensure that the 
sampled respondents are not phoned outside the speoified oalling hours. The call scheduler 
also allows oallbaoks to be set, and assigns status oodes to the ease. Using an algorithm based on 
the previous eall results, the eall seheduler determines whieh telephone number (e.g., home or 
work) assooiated with the ease should be ealled next. 



Call Center hours were 9:00 a.m. to 1 1 :00 p.m. Monday through Thursday, 9:00 a.m. to 9:00 p.m. Friday, 9:00 a.m. 
to 5:00 p.m. Saturday, 1 :30 p.m. to 9:30 p.m. Sunday, Eastern Time Zone. The CMS was programmed to account for 
time zones such that respondents would not be called after 9:00 p.m. their time. 
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The success of the 2004 National Study of Postsecondary Faculty (NSOPF:04) field test 
was dependent upon achieving high levels of cooperation at all stages of the data collection 
process. The data collection results — namely the institution and faculty response rates, along 
with the results of efforts that contributed to those rates — are the focus of this chapter. These 
results address some of the major questions of the field test, namely the following: 

• How did combining NSOPF and the National Postsecondary Student Aid Study 
(NPSAS) impact institution data collection? 

• What were the response rates of the faculty data collection with a 5 -month field 
period, and given the elimination of the paper option? 

• What was the distribution of web and computer-assisted telephone interviewing 
(CATI) completes? Was the goal of 50 percent web completes and 50 percent CATI 
reached? 

• What role did incentives play in fostering early response and nonresponse follow-up? 
Were they cost effective? 

• How much effort, and of what type, was needed for locating and tracing? 

• How long did the web and CATI surveys take to complete? Were the goals of 
shortening the survey met? 

• What was the level of effort required to achieve the response rate? 

3.1 Institution Data Collection Results 

3.1.1 Institution Participation 

Of the 150 institutions selected to participate in the field test for NSOPF:04, 149 were 
found to be eligible institutions. These eligible institutions were subsampled to 75 institutions 
for sampling faculty to accommodate time constraints. Although faculty and staff were not 
sampled from all eligible institutions, attempts were made to secure lists of faculty and 
completed institution questionnaires from all sampled institutions until the end of the data 
collection period in order to test the procedure. Of the 149 eligible institutions, 147 (99 percent) 
appointed an Institutional Coordinator (IC) to assist with study requirements, 134 (90 percent) 
provided a list of faculty and instructional staff, and 1 14 (77 percent) completed the institution 
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questionnaire. The breakdown of institutions providing faculty lists and completing the 
institution questionnaire by institution type are presented in table 3.1. 



Table 3.1 Number of institutions providing lists and completing the institution questionnaire, by 
type of institution: 2003 



Institution type 


Number of 
eligible 
institutions 


Provided lists 
Number Percent 


Completed 

questionnaire 

Number Percent^ 


Total 


149 


134 


89.9 


114 


76.5 


Public master’s 


25 


23 


92.0 


21 


84.0 


Public baccalaureate 


6 


6 


100.0 


5 


83.3 


Public associate’s 


58 


50 


86.2 


44 


75.9 


Public other/unknown 


4 


4 


100.0 


2 


50.0 


Private not-for-profit master’s 


26 


24 


92.3 


19 


73.1 


Private not-for-profit baccalaureate 


21 


18 


85.7 


16 


76.2 


Private not-for-profit associate’s 


3 


3 


100.0 


3 


100.0 


Private not-for-profit other/unknown 


6 


6 


100.0 


4 


66.7 



Vercentages are based on the number of eligible institutions within the row under consideration. 

SOURCE: U.S. Department of Education, National Center for Education Statistics, 2004 National Study of 
Postsecondary Faculty (NSOPF:04) field test. 



Comparing the NSOPF:04 field test to previous cycles of NSOPF (see table 3.2), there is 
no evidence that combining the NSOPF and NPSAS had a measurable effect on the overall 
response rate for NSOPF. The period for field test institution data collection was slightly longer 
than that of the NSOPF:99 field test; however, since the current field test occurred at a time 
when many postsecondary institutions were experiencing severe fiscal constraints that may have 
affected the resources available for the study, it is difficult to determine what role, if any, 
fielding the two studies together may have played in extending the data collection period. 



Table 3.2 Institution participation rates (faculty lists), by cycle of the National Study of 



Postsecondary Faculty (NSOPF) 


NSOPF cycle 


Number 

eligible 


Number 
providing list 


Participation rate 
(unweighted percent) 


Length of 
effort 


NSOPF:88 field test 


105 


96 


91.4 


9 weeks 


NSOPF:88 full-scale study 


480 


449 


93.5 


24 weeks 


NSOPF:93 field test 


136 


121 


89.0 


28 weeks 


NSOPF:93 full-scale study 


962 


817 


84.9 


34 weeks 


NSOPF:99 field test 


162 


146 


90.1 


30 weeks 


NSOPF:99 full-scale study 


959 


819 


85.4 


54 weeks 


NSOPF:04 field test 


149 


134 


89.9 


34 weeks 



SOURCE: U.S. Department of Education, National Center for Education Statistics, 2004 National Study of 
Postsecondary Faculty (NSOPF:04) field test. 



Institutions were offered several options for submitting their faculty lists. The preferred 
type of list was a single, unduplicated (i.e., duplicate entries of names were removed) electronic 
faculty list, because such a list required no processing prior to electronic sampling. However, 
any set of electronic lists was preferable to hardcopy lists because they could easily be 
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unduplicated using the faeulty identification (ID) number. Table 3.3 provides the distribution of 
faeuity lists submitted, by transmittal mode, for eaeh of the sampling strata. Approximately 89 
pereent of institutions that provided lists did so eleotronieally (either uploading it to the NSOPF 
website, sending by e-mail, or mailing a diskette), and 1 1 pereent provided hardeopy lists 
(information eulled from a eourse eatalog, direetory, or pre-existing personnel file). 

Table 3.3 Number of faculty lists, by type of institution and transmittal mode: 2003 



Institution type 


Number of 
sampled 
institutions 


Number of institutions providing lists via 
the four transmittal modes 

Total E-mail Upload Diskette Paper 


Total 


150 


134 


52 


66 


1 


15 


Public master’s 


25 


23 


9 


13 


0 


1 


Public baccalaureate 


6 


6 


4 


2 


0 


0 


Public associate’s 


58 


50 


19 


26 


1 


4 


Public other/unknown 


5 


4 


4 


0 


0 


0 


Private not-for-profit master’s 


26 


24 


8 


11 


0 


5 


Private not-for-profit baccalaureate 


21 


18 


6 


9 


0 


3 


Private not-for-profit associate’s 


3 


3 


1 


1 


0 


1 


Private not-for-profit other/unknown 


6 


6 


1 


4 


0 


1 



SOURCE: U.S. Department of Education, National Center for Education Statistics, 2004 National Study of 
Postsecondary Faculty (NSOPF:04) field test. 

3.1.2 Institution Survey Compietion Timing 

The timing analysis was eondueted by embedding time stamps in the programming eode 
for eaeh form (sereen) in the survey. From these time stamps, the number of seeonds spent on 
each screen (on-screen time) and the transit time between sereens (i.e., the time required to 
transmit data to the server, the time for the server to store the data and assemble the next page, 
and the time for the page to be transmitted and loaded on the eomputer) were ealeulated. A 
eumulative on-sereen time and a eumulative transit time for the institution survey also were 
ealeulated from the time stamps. The sum of the eumulative on-sereen and transit times was the 
total instrument time — that is, the number of minutes it took to administer the questionnaire. 

Unlike most questionnaires, whieh require the respondent to eomplete the survey in 
sequential order, the institution questionnaire ineluded a status sereen that allowed respondents 
to jump to partieular questions they eould answer, while skipping over ones they eould not 
answer. For most institutions, the questionnaire was eompleted in multiple Internet sessions and, 
in some eases, by multiple people at the institution. 

Projeet staff estimated the average time to eomplete the institution questionnaire would 
be approximately 50 minutes. Based on the time stamps for eaeh form, the time to eomplete the 
entire questionnaire ranged from 6 to 107 minutes, with an average of 27 minutes. Of these 27 
minutes, approximately 23 minutes, on average, were spent answering questions (on-sereen time) 
and 4 minutes, on average, were spent in transit. These numbers may be misleading beeause 
some institutions apparently completed the sample hardeopy version of the questionnaire in 
advanee, so their time to complete the web questionnaire simply reflected the time it took to key 
in their responses. 
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Five forms (screens) of the institution survey took more than 1 minute to complete, on 
average, as shown in table 3.4. Each of these five screens required the respondent to look up 
information and/or requested several pieces of information, which accounts for the longer times 
on these screens. 

Table 3.4 Average and maximum completion time, in seconds, for forms averaging more than 
1 minute to administer: 2003 



Time, in seconds Number 

Form Description Average Maximum of cases 



1 Number of full-/part-time faculty, Fall 2002 

2 Changes in number of full-time faculty include (a) the total 
number of full-time faculty and instructional staff at the 
start of the 2001-02 academic year; (b) the number who 
changed from part-time to full-time status during the 
academic year; (c) the number hired; (d) the number 
retired; (e) the number who left for other reasons; (f) the 
number who changed from full-time to part-time status 
during the academic year; and (g) the total number at the 
start of the 2002-03 academic year. This screen included 
a check to determine whether the figures made sense 
(i.e., whether a+b+c-d-e-f=g, within 10 percent). 

2A Reason for discrepancy in reported numbers of full-time 
faculty, 1A and 2G. An exact match was required for the 
number of full-time faculty at the start of the 2002-03 
academic year (1 A and 2G). Form 2A was administered 
to the 17 schools that provided different counts. This 
screen displayed the two counts and asked the 
respondent to indicate which one needed to be corrected, 
or to type in the reason for the discrepancy in the text box 
provided. 

1 9 Assignment of undergraduate instruction by type of faculty 
or instructional staff included (a) full-time faculty or 
instructional staff; (b) part-time faculty or instructional staff; 
(c) teaching assistants such as graduate students who 
taught classes; and (d) others. A pop-up box appeared 
requiring resolution if the responses did not sum to 100 
percent. 



84 611 114 

163 1,377 113 



114 684 17 



81 528 114 



20 Contact information and comments/suggestions. The 177 937 114 

form came up each time the questionnaire was accessed, 
regardless of whether the institution had completed the 

form in an earlier section. 

NOTE: The number of cases per form varies due to the interview skip logic. Outliers for each form were top coded to 
the upper limit for that form. 

SOURCE: U.S. Department of Education, National Center for Education Statistics, 2004 National Study of 
Postsecondary Faculty (NSOPF:04) field test. 



3.2 Faculty Data Collection Results 

Faculty data collection efforts for the NSOPF:04 field test eonsisted of three essential 
steps: loeating (identifying telephone numbers and addresses for sample members), contaeting 
(carrying out the neeessary steps to reaeh the faeulty member), and eneouraging survey 
eompletion by web-based self-administration or CATI. This seetion deseribes the results of the 
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NSOPF:04 field test data eolleetion effort, and evaluates the effeetiveness of the data eollection 
proeedures used in loeating, eontaeting, and interviewing sample members. 

3.2.1 Response Rate 

Overall eontaeting and survey eompletion results for the faeulty eontact phase of the 
NSOPF;04 field test^^ are presented in figure 3.1. Of the 1,224 eases in the original sample, 27 
(2 pereent) were exeluded beeause they were ineligible for the study or deeeased. Of the 1,197 
eligible sample members, 1,096 (92 pereent) were eontaeted and 914 eompleted the survey, for 
an unweighted response rate of 76 pereent aehieved in the 5-month period from January 30 to 
June 30, 2003. 

Figure 3.1 Contacting and survey completion outcomes: 2003 




SOURCE: U.S. Department of Education, National Center for Education Statistics, 2004 National Study of 
Postsecondary Faculty (NSOPF:04) field test. 

3.2.2 Locating and Survey Completion 

Most of the faeulty lists provided by the institutions eontained eontact information for 
sample members, including the sample member’s name, office telephone number, school name, 
school address, and department. For some cases, home addresses also were provided. In 
addition, a number of approaches were used to locate faculty and instructional staff, including 
the initial mailing to all sample members, follow-up letters and e-mails to nonrespondents, 
telephone tracing (interviewers calling telephone numbers provided on the faculty lists as well as 
any additional numbers obtained during the course of making those calls), and intensive tracing 
(i.e., using consumer databases, Internet searches, and criss-cross directories). 

Before the start of data collection, batch database searches were conducted using the 
contact information provided by the institutions as noted in chapter 2. For many sample 
members, the database searches simply confirmed the contact information provided by the 



Faculty were selected from the first 75 institutions providing a complete list of faculty. 
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institution; in other cases, the searches resulted in new contact information. Tables 3.5, 3.6 and 
3.7 display locating and survey completion rates by batch processing source. 

Table 3.5 Locate and survey completion rates, by National Change of Address (NCOA) batch 
processing: 2003 



Located Completed survey 



NCOA match status 


Total 


Number 


Percent 


Number 


Percent 


Total 


888 


817 


92.0 


690 


77.7 


New information from NCOA 


36 


31 


86.1 


26 


72.2 


No match from NCOA 


852 


786 


92.3 


664 


77.9 



NOTE: Percentages are based on the total within the row under consideration. Although there were 1 ,224 in the 
sample, only cases with home address information provided in the faculty list were sent to NCOA. Because NCOA 
required a minimum of 200 cases for a batch search, near the end of advance tracing period some cases with home 
address information were not sent to NCOA as the minimum was not met. 

SOURCE: U.S. Department of Education, National Center for Education Statistics, 2004 National Study of 
Postsecondary Faculty (NSOPF:04) field test. 



Table 3.6 Locate and survey completion rates, by Lexis-Nexis batch processing: 2003 



Located Completed survey 



Lexis-Nexis match status 


Total 


Number 


Percent 


Number 


Percent 


Total 


873 


807 


92.4 


681 


78.0 


Confirmed/new information from Lexis-Nexis 


130 


125 


96.2 


103 


79.2 


No match from Lexis-Nexis 


743 


682 


91.8 


578 


77.8 



NOTE: Percentages are based on the total within the row under consideration. Although there were 1 ,224 in the 
sample, only cases with home address information provided in the faculty list (and possibly updated by the NCOA 
search) were sent to Lexis-Nexis. Lexis-Nexis file requirements were more stringent than NCOA, hence some cases 
that were sent to NCOA could not be sent to Lexis-Nexis. 

SOURCE: U.S. Department of Education, National Center for Education Statistics, 2004 National Study of 
Postsecondary Faculty (NSOPF:04) field test. 

Table 3.7 Locate and survey completion rates, by Telematch batch processing: 2003 



Located Completed survey 



Telematch match status 


Total 


Number 


Percent 


Number 


Percent 


Total 


932 


858 


92.1 


727 


78.0 


Confirmed/new information from Telematch 


599 


562 


93.8 


484 


80.8 


No match from Telematch 


333 


296 


88.9 


243 


73.0 



NOTE: Percentages are based on the total within the row under consideration. Although there were 1 ,224 in the 
sample, only cases with home information provided in the faculty list (and possibly updated by NCOA and Lexis- 
Nexis) were sent to Telematch (including cases that were not sent to NCOA because of their minimum batch size 
requirement or Lexis-Nexis because of their stringent file requirements). 

SOURCE: U.S. Department of Education, National Center for Education Statistics, 2004 National Study of 
Postsecondary Faculty (NSOPF:04) field test. 

First, faculty home address information obtained from the institutions was sent to 
National Change of Address (NCOA) to seareh for updates. NCOA does not eonfirm addresses; 
it either provides different address information or indieates that the address is not valid. Of the 
888 eases sent to NCOA, only 36 (4 pereent) were returned with different home address 
information (see table 3.5). Over 92 pereent of faeulty for whom NCOA did not find a match 
were loeated; the loeate rate for faeulty with information from NCOA was 86 pereent. Survey 
eompletion rates were 78 and 72 pereent, respeetively. 

The next database used was Lexis-Nexis, which either provided different home eontaet 
information (address and phone number) or eonfirmed the home eontaet information provided by 
the institutions. As illustrated in table 3.6, of the 873 eases sent to Lexis-Nexis, only 130 (15 
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percent) were returned with confirmed or different information. Ninety-six percent of faculty 
with different or confirmed information from Lexis-Nexis were located, compared with 92 
percent of those for whom Lexis-Nexis did not provide a match. Survey completion rates were 
79 and 78 percent, respectively. 

Finally, faculty home contact information was sent to Telematch for batch processing. 
Telematch uses a name, street address, and ZIP code as search criteria and provides telephone 
numbers only (not addresses). There were three possible results of a Telematch search; 
Telematch could (1) confirm the telephone number on file; (2) provide a different telephone 
number; or (3) indicate there was no match for the address on file. Of the 932 cases sent to 
Telematch, 599 (64 percent) were returned with confirmed or different information. Faculty 
with different or confirmed telephone numbers from Telematch had a locate rate of 94 percent 
and a survey completion rate of 81 percent, compared with an 89 percent locate rate and a 73 
percent completion rate for those who were not matched. 

In general, the contact information provided by the school proved effective in contacting 
faculty and instructional staff; 1,001 (82 percent) sample members required no intensive tracing, 
while the remaining 223 (18 percent) required intensive tracing. Because the contact information 
provided by the institution was generally quite good, batch database searches will be eliminated 
in the full-scale study. It is planned that advance tracing efforts instead target cases for which 
the school provided incomplete contact information. 

Intensive tracing was required when a case did not have a telephone number associated 
with it or the CATI calls had exhausted all numbers for the case without reaching the sampled 
individual. A total of 223 cases received intensive tracing (i.e., to identify a valid telephone 
number and/or address), of which 149 (67 percent) were located. About 49 percent of the cases 
that received intensive tracing completed the survey. Table 3.8 provides a breakdown of the 
tracing results for the 223 potentially eligible sample members sent for intensive tracing. Tracers 
found new home telephone or home address information for 71 percent of cases, new office 
telephone numbers for 15 percent of cases, and e-mail addresses for 2 percent of the cases. 
Tracers were only able to confirm the existing contact information on file for 4 percent of cases. 
Eighteen cases (8 percent) were classified as unlocateable. 

Table 3.8 Locate and survey completion rates, by outcome of intensive tracing efforts: 2003 

Located Completed survey 

Outcome of intensive tracing efforts Total Number Percent Number Percent 



Total 


223 


149 


66.8 


110 


49.3 


New telephone (only) 


6 


0 


0.0 


0 


0.0 


New address (only) 


12 


6 


50.0 


4 


33.3 


New address and phone 


141 


110 


78.0 


83 


58.9 


New office telephone number 


33 


23 


69.7 


16 


48.5 


E-mail only 


5 


0 


0.0 


0 


0.0 


No new information confirmed 


8 


5 


62.5 


3 


37.5 


Unable to locate telephone number 


18 


5 


27.8 


4 


22.2 



NOTE: Percentages are based on the total within the row under consideration. 

SOURCE: U.S. Department of Education, National Center for Education Statistics, 2004 National Study of 
Postsecondary Faculty (NSOPF:04) field test. 

Table 3.9 provides an overview of the primary sources used by tracers during the 
intensive tracing process. Tracers generally use multiple sources when tracing a case, so no one 
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source can be pinpointed as the one that resulted in the “locate.” Among the sources used most 
frequently for intensive tracing were Internet searches, directory assistance, and various 
consumer database searches. 

Table 3.9 Contact rates, by intensive tracing source: 2003 



Located 



Tracing source 


Total 


Number 


Percent 


Internet search 


213 


142 


66.7 


Directory assistance 


169 


115 


68.0 


Consumer database search - Lexis-Nexis 


91 


63 


69.2 


Reverse phone lookup - Database 


88 


61 


69.3 


Address search - Database 


64 


34 


53.1 


Consumer database search - Transunion 


64 


40 


62.5 


Name search - Database 


57 


36 


63.2 


Consumer database search - Experian search on Social Security number 


49 


33 


67.3 


Consumer database search - Experian address search 


34 


21 


61.8 


Other collateral source 


18 


10 


55.6 


Directory assistance - Plus 


13 


6 


46.2 



NOTE: Most cases were traced using multiple sources, so row totals and percentages are not mutually exclusive. 
SOURCE: U.S. Department of Education, National Center for Education Statistics, 2004 National Study of 
Postsecondary Faculty (NSOPF:04) field test. 



The breakdown of faculty and instructional staff requiring intensive tracing, by faculty 
status and institution type, is presented in table 3.10. Twenty-seven percent of part-time faculty 
required intensive tracing, compared to 9 percent for full-time faculty. Twenty percent of faculty 
at public institutions required intensive tracing compared to 14 percent at private not-for-profit 
institutions. 

Table 3.10 Faculty and instructional staff requiring intensive tracing procedures, by employment 
status and institution type: 2003 



Cases requiring intensive tracing 



Employment status and institution type 


Total 


Number 


Percentage 


Total 


1,224 


223 


18.2 


Employment status 


Full-time 


625 


59 


9.4 


Part-time 


585 


159 


27.2 


Unknown employment status 


14 


5 


35.7 


Institution control 


Public 


879 


175 


19.9 


Private not-for-profit 


345 


48 


13.9 


Institution type 


Public master’s 


272 


24 


8.8 


Public baccalaureate 


24 


0 


0.0 


Public associate’s 


578 


151 


26.1 


Private not-for-profit master’s 


193 


32 


16.6 


Private not-for-profit baccalaureate 


129 


12 


9.3 


Private not-for-profit associate’s 


5 


1 


20.0 


Other/unknown 


23 


3 


13.0 



NOTE: Percentages are based on the number of sample members within the row under consideration. 
SOURCE: U.S. Department of Education, National Center for Education Statistics, 2004 National Study of 
Postsecondary Faculty (NSOPF:04) field test. 
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The results of faculty and instructional staff locating and survey completion, broken 
down by faculty status and institution type, are shown in table 3.11. All full-time faculty 
members were located, compared with 97 percent of part-time faculty. Eighty-one percent of 
full-time faculty completed the survey, compared with 72 percent of part-time faculty. When 
examined by institution type, locate rates ranged from 97 to 100 percent. Survey completion 
rates ranged from 71 percent for faculty at public 2-year institutions to 100 percent at private not- 
for-profit 2-year institutions. 



Table 3.11 Faculty locating and survey completion results, by employment status and institution 
type: 2003 



Employment status and 
institution type 


Total 


Located 


Number . 


Completed survey 


sample 


Number 


Percent^ 


eligible 


Number 


Percent^ 


Total 


1,224 


1206 


98.5 


1,197 


914 


76.4 


Employment status 


Full-time 


625 


625 


100.0 


613 


495 


80.8 


Part-time 


585 


568 


97.1 


570 


409 


71.8 


Unknown employment status 


14 


13 


92.9 


14 


10 


71.4 


Institution control 


Public 


879 


861 


98.0 


857 


628 


73.3 


Private not-for-profit 


345 


345 


100.0 


340 


286 


84.1 


Institution type 


Public master’s 


272 


269 


98.9 


267 


209 


78.3 


Public baccalaureate 


24 


24 


100.0 


23 


18 


78.3 


Public associate’s 


578 


563 


97.4 


562 


399 


71.0 


Private not-for-profit master’s 


193 


193 


100.0 


190 


160 


84.2 


Private not-for-profit baccalaureate 


129 


129 


100.0 


127 


106 


83.5 


Private not-for-profit associate’s 


5 


5 


100.0 


5 


5 


100.0 


Other/unknown 


23 


23 


100.0 


23 


17 


73.9 



' Percentages are based on the number of sample members within the row under consideration. 

^ Percentages are based on the number of eligible sample members within the row under consideration. 
SOURCE: U.S. Department of Education, National Center for Education Statistics, 2004 National Study of 
Postsecondary Faculty (NSOPF:04) field test. 



The results of faculty and instructional staff survey completion by mode of data 
collection are presented in table 3.12. A total of 559 respondents completed the self- 
administered web survey and 355 respondents completed the CATI interview. Self-administered 
questionnaires accounted for 61 percent of all completed surveys, and telephone questionnaires 
accounted for the remaining 39 percent of completed surveys. While the NSOPF:04 field test 
exceeded the goal of having 50 percent of completes by web, a substantial portion of these web 
surveys were completed only after having been called by a CATI interviewer. 
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Table 3.12 Response rates and mode of completion, by employment status and institution type: 
2003 



Mode of completion 



Employment status and 


Number 


Total responses 


Self -administered 


CATI 




institution type 


eligible 


Number 


Percent' 


Number 


Percent^ 


Number Percent'^ 


Total 


1,197 


914 


76.4 


559 


61.2 


355 


38.8 


Employment status 


Full-time 


613 


495 


80.8 


333 


67.3 


162 


32.7 


Part-time 


570 


409 


71.8 


220 


53.8 


189 


46.2 


Unknown employment status 


14 


10 


71.4 


6 


60.0 


4 


40.0 


Institution control 


Public 


857 


628 


73.3 


359 


57.2 


269 


42.8 


Private not-for-profit 


340 


286 


84.1 


200 


69.9 


86 


30.1 


Institution type 


Public master’s 


267 


209 


78.3 


136 


65.1 


73 


34.9 


Public baccalaureate 


23 


18 


78.3 


7 


38.9 


11 


61.1 


Public associate’s 


562 


399 


71.0 


215 


53.9 


184 


46.1 


Private not-for-profit master’s 


190 


160 


84.2 


107 


66.9 


53 


33.1 


Private not-for-profit 


baccalaureate 


127 


106 


83.5 


77 


72.6 


29 


27.4 


Private not-for-profit associate’s 


5 


5 


100.0 


4 


80.0 


1 


20.0 


Other/unknown 


23 


17 


73.9 


13 


76.5 


4 


23.5 



'Percentages are based on the number of eligible sample members within the row under consideration. 
^Percentages are based on the number of completed interviews within the row under consideration. 

NOTE: All percentages are unweighted. Reporting excludes 27 cases determined to be ineligible for study. 
SOURCE: U.S. Department of Education, National Center for Education Statistics, 2004 National Study of 
Postsecondary Faculty (NSOPF:04) field test. 



Sixty-seven pereent of full-time faculty completed the self-administered survey, 
compared to 54 percent of part-time faculty. Seventy percent of faculty and instructional staff at 
private not-for-profit institutions completed the self-administered survey, compared to 57 percent 
of faculty at public institutions. Web survey completion rates by institution type ranged from 39 
percent for public baccalaureate degree-granting schools to 80 percent for private not-for-profit 
associate’s degree-granting schools. The cumulative response rate, overall and by mode, is 
shown in figure 3.2. 
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Figure 3.2 Cumulative response rates, by mode of completion: 2003 

Percent 




Weeks 

Total Web -^-CATI 



NOTE: Mode of completion for respondents who switched modes was determined by the mode at the time of survey 
completion. 

SOURCE: U.S. Department of Education, National Center for Education Statistics, 2004 National Study of 
Postsecondary Faculty (NSOPF:04) field test. 

3.2.3 E-mail Contacting Efforts 

Valid e-mail addresses were available for 765 of the 1,197 eligible sample members. E- 
mail addresses of faeulty and instruetional staff were requested in the faeulty lists. Where e-mail 
addresses were not provided by the institution, help desk staff searehed the institution’s online 
direetory for e-mail addresses of sample members. In addition, some sample members provided 
e-mail addresses when eontaeted by a telephone interviewer. If an e-mail message to a sample 
member was returned as undeliverable, it was not eonsidered to be a valid e-mail address for the 
purpose of this analysis. 

Periodieally throughout the data eollection period, e-mail messages were sent to 
nonrespondents for whom we had e-mail addresses to eneourage their participation (see appendix 
D). Sample members for whom we had valid e-mail addresses were more likely to complete the 
survey (80 percent) compared to sample members to whom no e-mail reminders were sent (69 
percent; x^=18.8,/><0.0001). Respondents with valid e-mail addresses were more likely to 
complete the self-administered web questionnaire (67 percent) than were respondents who did 
not receive e-mail reminders (49 percent; x =27.8, /><0. 0001). 

3.2.4 Refusal Conversion Efforts 

Refusal conversion measures were used to gain cooperation from individuals who refused 
to participate when contacted by telephone interviewers. Refusals came not only from sample 
members, but also occasionally from other household members. Whenever a refusal was 
encountered, unless it was deemed hostile, the case was referred to a specialist trained in refusal 
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conversion techniques. Refusal eonversion speeialists were ehosen based on their performanee 
as interviewers, with those who were the most skilled in obtaining eooperation given additional 
training in converting refusals. This training was tailored to the coneerns of faeulty members 
and gatekeepers regarding participation, and focused on gaining cooperation, and eneouraging 
partieipation. 

Fourteen pereent of eontaeted oases (n=149) refused to partioipate at some point during 
data oolleotion. However, nearly one-fifth (18 percent, n=27) of these oases were suooessfully 
oonverted and eventually oompleted the survey. Sixteen of these oases oompleted the survey by 
web and 1 1 oases oompleted by telephone. 

3.2.5 Incentive Experiment Resuits 

As discussed in chapter 2, the inoentive experiment assessed three hypotheses (see 
ohapter 2 for greater detail on the experiment design): 

Hypothesis I: Inoentives inorease the response rate during the initial phase of data oolleotion 

(phase I) and promote a higher rate of web-based responses. 

Hypothesis II: Inoentives inorease the oompletion rate during the nonresponse follow-up phase 
of CATI data oolleotion (phase III). 

Hypothesis HI: A higher amount of inoentive inoreases the response rate more than a lower 
amount. 

The results of eaoh phase of the experiment are disoussed below. 

Analysis of Phase I Data 

All faeulty members were partitioned into the three early-response treatment groups. As 
desoribed in chapter 2, those in the first treatment group (ERl) were offered no inoentive, while 
those in the second (ER2) and third (ER3) treatment groups were offered $20 or $30, 
respeotively, to oomplete the survey within 3 weeks of reoeiving their invitation letters. 

Table 3.13 shows the distribution of the eligible respondents and nonrespondents for the first 
phase of the experiment and the response rates aohieved in phase I. 



Table 3.13 Faculty distribution and response rates for phase I (faculty in groups ER2 and ER3 
were offered incentives): 2003 



Treatment group (early response), 
and incentive amount offered 


Total 


Respondent 


Nonrespondent 


Response rate 
(percent) 


Total 


1,197 


324 


873 


27.1 


ERl ($0) 


402 


66 


336 


16.4 


ER2 ($20) 


391 


120 


271 


30.7 


ER3 ($30) 


404 


138 


266 


34.2 



SOURCE: U.S. Department of Education, National Center for Education Statistics, 2004 National Study of 
Postsecondary Faculty (NSOPF:04) field test. 



These results indieate that ineentive use nearly doubled the response rate during the early 
response period; approximately 16 pereent of those who were not offered an ineentive eompleted 
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the questionnaire eompared with 32 pereent of those who were offered an ineentive. Signifieant 
differenees were found between the no ineentive group (ERl), with 16 pereent response, and 
both the $20 (ER2) and $30 (ER3) ineentive groups, with 31 pereent and 34 pereent response, 
respeetively (p<0.0001). However, the differenee between the $20 and $30 ineentive, although 
in the expeeted direetion, was not statistieally signifieant.^^ While this differenee is direetionally 
in support of the third hypothesis, there is not enough evidenee to eonelude that an inerease in 
the ineentive amount signifieantly inereased the response rate of faeulty members during the first 
phase. 



Analysis of Phase II Data 

Attempts were made to eomplete as many surveys as possible during the seeond phase of 
data eolleetion without offering any ineentives. Eor this purpose, all nonrespondents from the 
first phase were eontaeted by telephone and asked to eomplete the survey, either on the phone or 
via the web at their eonvenienee. Table 3.14 shows the distribution of the respondents and 
nonrespondents for the seeond phase of the experiment. (The elassifieation is based on the 
amount offered during the first phase of the experiment even though no one was aetually offered 
an ineentive during this phase [i.e., phase 11].) 



Table 3.14 Faculty distribution and response rates for phase II (no-incentive phase), by phase I 
incentive groups: 2003 



Treatment group (early response), 
and incentive amount offered 


Total 


Respondent 


Nonrespondent 


Response rate 
(percent) 


Total 


873 


296 


577 


33.9 


ERl ($0) 


336 


109 


227 


32.4 


ER2 ($20) 


271 


91 


180 


33.6 


ER3 ($30) 


266 


96 


170 


36.1 



NOTE: In phase II, computer-assisted telephone interviewing began; no one was offered incentives. 
SOURCE: U.S. Department of Education, National Center for Education Statistics, 2004 National Study of 
Postsecondary Faculty (NSOPF:04) field test. 



No significant differences in response rates during the seeond phase were deteeted 
between those who were offered ineentives during the first phase and those who were not 
(35 pereent vs. 32 pereent, respeetively). This finding suggests that no residual effeets were 
earned over from the first phase to the seeond phase. That is, having been offered an ineentive 
during the first phase had no signifieant effect on response rates during the second phase when 
no one was offered any ineentives. 

Analysis of Phase III Data 

At the start of the third phase, the remaining nonrespondents were eontaeted by telephone 
for nonresponse follow-up. Those who were pre-assigned to the CATl nonresponse follow-up 
treatment group NEl were offered no ineentive, while those in treatment group NE2 were offered 
$30 to complete the survey. Table 3.15 shows the distribution of the resulting respondents and 
nonrespondents for the third phase of the incentive experiment. 



Simple tests of significance for two population proportions have been used to assess the stated hypotheses. 
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Table 3.15 Faculty distribution and response rates for phase III: 2003 

Treatment group (nonresponse follow-up), Response rate 

and incentive amount offered Total Respondent Nonrespondent (percent) 



Total 


577 


233 


344 


40.4 


NF1 ($0) 


288 


98 


190 


34.0 


NF2 ($30) 


289 


135 


154 


46.7 



NOTE: Faculty in group NF2 were offered an incentive. 

SOURCE: U.S. Department of Education, National Center for Education Statistics, 2004 National Study of 
Postsecondary Faculty (NSOPF:04) field test. 



Accordingly, 98 of the 288 faculty who were not offered an ineentive responded to the 
survey during the third phase (34 pereent), while 135 of the 289 faculty who were offered the 
ineentive responded to the survey during this phase (47 pereent). The observed differenee of 13 
pereentage points was statistieally signifieant (/?<0.002). Comparing the distribution of these 
faculty members with respect to their phase I ineentive eategories, there was no significant 
interaction between phase I and phase III ineentive groups (p<0.07). This suggests that the effect 
of the ineentive during phase III is independent of ineentive offerings during the first phase of 
the experiment. 

3.3 Burden and Effort 

3.3.1 Faculty Survey Completion Timing 

Like the institution timing analysis, the faeulty timing analysis was condueted by 
embedding time stamps in the programming eode for eaeh form (sereen) in the survey. From 
these time stamps, the number of seeonds spent on each screen (on-sereen time) and the transit 
time between sereens (i.e., the time required to transmit data to the server, the time for the server 
to store the data and assemble the next page, and the time for the page to be transmitted and 
loaded on the computer) were caleulated. A eumulative on-sereen time and a cumulative transit 
time for the faculty survey also were ealculated from the time stamps. The sum of the 
eumulative on-sereen and transit times was the total instrument time — that is, the number of 
minutes it took to administer the questionnaire. 

Following the 1999 eyele of NSOPF — whieh averaged over 50 minutes — the faeulty 
questionnaire was shortened substantially, with a goal of achieving a 30-minute survey. Based 
on the time stamps for eaeh form, the time to eomplete the entire survey ranged from 9 minutes 
to 2 hours and 12 minutes, with an average time of 42 minutes. Of these 42 minutes, 
approximately 35 minutes, on average, were spent answering questions (on-sereen time) and 7 
minutes, on average, were spent saving data and loading forms (transit time). 

Table 3.16 presents the overall timing data by mode. Average on-sereen time was 
signifieantly longer for CATI respondents than for web respondents (38 minutes and 34 minutes, 
respeetively; t= -3.67, /><0. 001), while the average transit time was signifieantly shorter for 
CATI respondents than for web respondents (4 minutes and 9 minutes, respeetively; t=13.26. 



^^This total time includes all screens in the survey — i.e., 01 through Q84 — plus the screens that collected the contact 
information for the incentive payment and the reinterview. No timing data are available for the informed consent 
screens. 
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/><0.0001). The longer on-sereen time for CATI respondents presumably is beeause it takes 
longer to read text out loud and the respondent may ask questions. The shorter transit time for 
CATI is likely due to the use of a high-speed Internet eonneetion by interviewers. Some web 
respondents may have used a slower dial-up eonneetion, whieh would tend to inerease their 
transit time. There was no signifieant differenee in total survey time by mode. 



Table 3.16 Average on-screen, transit, and total survey completion time, in minutes, for the field 
test faculty questionnaire, by mode: 2003 





All respondents 


Web respondents 


CATI respondents 


Portion of interview 


Average 

time 


Number 
of cases 


Average 

time 


Number 
of cases 


Average 

time 


Number 
of cases 


Total 


42.2 


891 


42.6 


543 


41.7 


348 


Onscreen 


35.5 


908 


34.2 


555 


37.6 


353 


Transit 


7.2 


891 


9.0 


543 


4.4 


348 



NOTE: Three on-screen time outliers and one transit time outlier were topcoded to the upper limit. In addition, 17 
cases with invalid transit times were removed from the calculation of average transit time and average total time. 
SOURCE: U.S. Department of Education, National Center for Education Statistics, 2004 National Study of 
Postsecondary Faculty (NSOPF:04) field test. 



The transit times were signifieantly longer for surveys that were completed during 
business hours (Monday through Friday, 9:00 am - 6:00 pm) compared to those completed 
during evening and weekend hours (7.5 and 6.8 minutes, respectively; t= -2.02, p<0.05.), as 
shown in table 3.17. This is likely due to heavier Internet traffic during business hours. 



Table 3.17 Average on-screen, transit, and total completion time, in minutes, by time of day and 
mode: 2003 



Portion of 
interview 




Web respondents 






CATI respondents 




Weekdays 9am-6pm 


Evenings/ weekends 


Weekdays 9am-6pm 


Evenings/ weekends 


Average 

time 


Number 
of cases 


Average 

time 


Number 
of cases 


Average 

time 


Number 
of cases 


Average 

time 


Number 
of cases 


Total 


41.8 


301 


43.6 


242 


45.1 


186 


37.7 


162 


Onscreen 


34.0 


311 


34.4 


244 


39.5 


189 


35.5 


164 


Transit 


8.6 


301 


9.5 


242 


5.8 


186 


2.8 


162 



NOTE: Three on-screen time outliers and one transit time outlier were topcoded to the upper limit. In addition, 17 
cases with invalid transit times were removed from the calculation of average transit time and average total time. 
SOURCE: U.S. Department of Education, National Center for Education Statistics, 2004 National Study of 
Postsecondary Faculty (NSOPF:04) field test. 



Eight forms (screens) in the faculty survey took more than 1 minute to administer, on 
average. These tended to be the more complicated forms and those that requested more 
information — often containing several items on the same screen or complex online coding. The 
average and maximum times (in seconds) to complete these forms are presented in table 3.18. 
The forms are described in greater detail in the text that follows table 3.18. 
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Table 3.18 Average and maximum completion time, in seconds, for forms averaging more than 1 
minute to complete: 2003 

Questionnaire Time (seconds) Number 



form 


Description 


Average 


Maximum 


of cases 


Q17A4 


Highest degree institution 


62 


323 


844 


Q31 


Hours worked per week 


81 


454 


914 


Q32 


Percentage distribution of work activities 


63 


353 


914 


Q34 


Percentage other (noninstruction, nonresearch) 
time 


82 


428 


722 


Q37 


Number and types of classes taught (up to eight 
classes) 


101 


532 


796 


Q38 


Student evaluation tools (Tools instructors use to 
evaluate students — essay exams, etc.) 


76 


382 


736 


Q52A 


Career publicatlons/presentatlons 


77 


514 


911 


Q66 


Income: from institution/other sources 


102 


573 


908 


NOTE: The number of cases per form varies due to the interview skip logic. Outliers for each form were topcoded to 
the upper limit for that form. 

SOURCE: U.S. Department of Education, National Center for Education Statistics, 2004 National Study of 
Postsecondary Faculty (NSOPF:04) field test. 



Q17A4. The Integrated Postseeondary Education Data System (IPEDS) coding form, 
used to code respondent highest degree information (Q17A4), took slightly more than 1 minute 
to administer, on average. This screen required input of the state and city in which the school 
was located, followed by a computer search to identify the schools in that location. The form 
presented the list of possible schools, from which the respondent or interviewer selected the 
correct one. Web respondents took significantly longer to complete this form (75 seconds) than 
CATI respondents (43 seconds; t=l 1.23, /><0. 0001). This time difference reflects a learning 
curve associated with the IPEDS coding. The telephone interviewers were familiar with how 
these screens worked and did not have to read the instructions. 

Q31, Q32, and Q34, The series of questions that asked for the number of hours per 
week spent on work activities, Q3 1 (broken down into paid and unpaid activities at the target 
institution and outside that institution), and the percentage distribution of work activities, Q32 
and Q34, took 81, 63, and 82 seconds, respectively, to administer. Each of these took longer 
when administered by telephone interviewers than when self-administered via the web 
instrument. Q3 1 averaged 74 seconds for web respondents compared with 92 seconds for CATI 
respondents {t= -5.09, /><0. 0001). Web respondents averaged 60 seconds on Q32 compared with 
70 seconds for CATI respondents (t=3.35,/><0.001). On Q34, web respondents took 75 seconds, 
on average, compared with 93 seconds for CATI respondents {t= -4.10,/><0.0001). The 
complexity of these questions may have led to the longer times for CATI administration, as 
respondents often asked interviewers to repeat the question and examples, and asked questions 
about the appropriate category for certain types of activities. 

Q37 and Q38. Two consecutive forms, Q37 and Q38, asked for a great deal of 
information on a single screen. Q37 asked six questions about each of the credit classes (up to 
eight) the respondent taught. This form took 101 seconds, on average, to administer. There was 
no difference in time by mode of administration. Q38 asked respondents to identify which of 10 
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different types of student evaluation tools were used in their classes and whether they were used 
in all, some, or none of the classes. This form took an average of 76 seconds to administer, with 
CATI respondents taking significantly longer than web respondents (98 and 62 seconds, 
respectively, t= -12.43, /><0. 0001). 

Q52A, Q52a, which asked for the number of career publications or presentations in 
seven categories, took an average of 77 seconds to complete. This may have required 
respondents to locate their curricula vitae and count the number of publications. There was no 
difference by mode in time to administer this form. 

Q66. The form asking about respondents’ compensation from the target institution and 
from other sources, Q66, took 102 seconds to complete, on average. This form consisted of six 
income questions, which were considered to be among the most sensitive items in the 
questionnaire. Average time to complete this form was shorter for web respondents (98 seconds) 
than for CATI respondents (108 seconds; t= -2.1 1,/»<0.05). 

3.3.2 Help Desk 

In order to gain a better understanding of the problems encountered by faculty members 
attempting to complete the survey over the web, software was developed to record each help 
desk incident that occurred during data collection. For each occurrence, help desk staff 
confirmed contact information for the sample member, recorded the type of problem, described 
the problem and resolution, noted its status (pending or resolved), and recorded the approximate 
time it took to assist the faculty member. Help desk staff were trained not only to answer any 
calls received from the help desk hotline, but also to conduct telephone interviews when needed. 
Help desk staff members assisted sample members with questions about the web instrument and 
provided technical assistance to sample members who experienced problems while completing 
the self-administered web survey. Help desk agents also responded to voice mail messages left 
by respondents when the call center was closed. 

Help desk staff assisted 184 faculty members (15 percent of the sample). Eighty-two 
percent of these cases called the help desk only once, while 14 percent called in twice, and 4 
percent called in three times. Of the 184 faculty members who called the help desk, 151 (82 
percent) eventually completed the survey. 

Thirty-eight percent of the problems reported by faculty members who called the help 
desk were for miscellaneous issues (see table 3.19). The most frequent miscellaneous incident 
reported was sample members requesting to complete the survey by telephone (41 percent of 
miscellaneous cases). Other problems reported to the help desk included questions about the 
study (22 percent), requests for study ID and/or password (19 percent), browser setting and 
computer problems (8 percent), website being down or unavailable (6 percent), questions about 
questionnaire content (4 percent), and errors in questionnaire programming (3 percent). 
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Table 3.19 Response pattern, by help desk problem type: 2003 



Type of problem 


Number 


Percentage 


Total 


225 


100.0 


Miscellaneous (including asking to complete the survey by phone) 


85 


37.8 


Question about study 


49 


21.8 


Study identification (ID) code/password 


43 


19.1 


Browser settings/computer problems 


18 


8.0 


Website unavailable 


14 


6.2 


Questionnaire content 


9 


4.0 


Program error 


7 


3.1 



SOURCE: U.S. Department of Education, National Center for Education Statistics, 2004 National Study of 
Postsecondary Faculty (NSOPF:04) field test. 



3.3.3 Interviewer Hours 

Telephone interviewing staff hours (ineluding help desk staffing, telephone follow-up 
calls, and CATI interview hours) for the NSOPF:04 field test required 1,563 hours. These hours 
do not include supervision, monitoring, administration, and Quality Circle meetings. The 
average time spent per completed CATI interview was 4 hours and per completed interview 
overall (including web completes) was 1 .7 hours. The average time to administer the CATI 
interview was 42 minutes, which shows that a majority of interviewer time was spent on other 
activities. These other activities focused on contacting and locating the sample member, with a 
small portion of time devoted to bringing up a case, reviewing its history, and closing the case 
(with the appropriate reschedule, comment, and disposition). A significant proportion of the web 
completes occurred after the period of telephone follow-up began, and were completed only after 
several CATI follow-up calls had been made to the respondent. 

3.3.4 Number of Calls 

Telephone interviewers made 18,342 call attempts to faculty members during the 
NSOPF:04 field test data collection period (see table 3.20). The number of calls per case ranged 
from 0 to 182. On average, 15 calls^"^ were made to each sample member. The largest average 
numbers of calls were made to those who were not interviewed. Among completed cases, an 
average of 9 call attempts were required, while the average for nonrespondents was 32 call 
attempts (f=10.32,/»<0.0001). Faculty members who completed the questionnaire over the web 
were called significantly fewer times, with an average of 7 call attempts per completed survey, 
compared to an average of 12 calls to CATI respondents {t= -4.62, /»<0. 0001). 



figure includes cases where no call attempts were made, either because the respondent completed the 
questionnaire via the web before CATI calling began, or the individual could not be located. 
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Table 3.20 Total and average number of calls, by completion status and mode of completion: 2003 


Completion status/mode 


Number 
of cases 


Number 
of calls 


Average calls 
per case 


Total 


1,224 


18,342 


15.0 


Interviewed 


914 


8,340 


9.1 


Not interviewed 


310 


10,002 


32.3 


By mode 


914 


8,340 


9.1 


Web complete 


559 


3,967 


7.1 


Computer-assisted telephone interview complete 


355 


4,373 


12.3 



SOURCE: U.S. Department of Education, National Center for Education Statistics, 2004 National Study of 
Postsecondary Faculty (NSOPF:04) field test. 



Call screening is a growing problem for studies that rely on the telephone as a mode of 
contact. Devices sueh as telephone answering machines ean be used to sereen unwanted calls. 

Of the 848 cases called by telephone interviewers, 697 cases (82 pereent) reaehed an answering 
maehine at least onee (see table 3.21). Interviewers made significantly more calls to cases where 
an answering maehine had been reaehed at least once (mean attempts=25), compared to cases 
where no answering machine was reached (mean attempts=8; t= -10.00, /><0. 0001). Likewise, 
eases where an answering machine had been reached at least once were less likely to have 
eompleted the interview (65 percent) than cases where no answering maehine was reached (75 
pereent; 'i=5A,p<0.02). 



Table 3.21 Average call attempts, by reached answering machine: 2003 





Cases called in CATI 


Completed cases 


Result of call attempt 


Number 
of cases 


Average 
number of 
calls 


Number 
of cases 


Average 
number 
of calls 


Reached answering machine at least once 


697 


24.7 


453 


16.5 


Never reached an answering machine 


151 


7.5 


113 


7.8 



NOTE: Excludes 337 completed cases that were never called by telephone interviewers because they completed the 
self-administered questionnaire during or soon after the early response period of data collection. Some of the 848 
cases called by telephone interviewers actually completed the web self-administered questionnaire. 

SOURCE: U.S. Department of Education, National Center for Education Statistics, 2004 National Study of 
Postsecondary Faculty (NSOPF:04) field test. 



Looking only at completed cases, significantly fewer calls were required to obtain a 
eompleted interview when no answering machine was reaehed (mean attempts=8) eompared to 
cases in which an answering maehine was reaehed at least once (mean attempts=16, t= -4.52, 
/><0.0001). Those who possessed answering machines were included in the survey definition of 
“accessible”; however, it took considerable persistence and resources (in the form of repeated 
call attempts) to reaeh these faculty members. This finding demonstrates that answering 
machines and other eall sereening devices are increasing the effort that must be expended to 
reach these cases, thereby driving up interviewing costs. 



^®An additional 337 cases were never called by telephone interviewers because they completed the self-administered 
questionnaire during or soon after the early response period of data collection. Some of the 848 cases called by 
telephone interviewers actually completed the web self-administered questionnaire. 
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3.4 Discussion 

The response rates to the field test, while useful for planning for the full-seale study, must 
be interpreted with eaution due to some important differences between the NSOPF:04 field test 
and full-scale studies. Some of these factors will make the data collection for the full-scale study 
more difficult, and others may make it easier. While the field test response rates give some 
indication of what to expect on the full-scale study, fundamental differences, outlined below, 
limit the generalizability to the full-scale study. 

• The full-scale NSOPF;04 will not have the complete sample at the start of data 
collection, due to the anticipated number of late lists. (Early institution contacting is 
expected to reduce the percentage of late lists from that experienced in earlier NSOPF 
cycles, but it will not eliminate them.) The field test sampled faculty from the first 
one-half of the lists received and hence had a full sample in January at the start of 
faculty data collection. 

• The full-scale data collection period is scheduled to last 2 months longer than the 
field test 5-month period (until August 30, while the field test ended on June 30). 

• The full scale study plans to offer the early response and nonresponse incentives to all 
respondents, whereas the field test had several experiments in which randomly 
selected subsamples were offered no incentives and two amounts. 

• The field test sample did not include faculty from doctoral granting institutions who 
might be expected to use the web option the most frequently and who traditionally 
have responded at higher rates on previous cycles of NSOPF. 
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Evaluations of data quality serve to identify problems with the data eolleetion proeesses 
and instruments. In preparation for the full-seale 2004 National Study of Postseeondary Faeulty 
(NSOPF:04), projeet staff evaluated faeulty list quality, item nonresponse, item reliability, inter- 
item eonsisteney, item mode effeets, breakoffs, help text usage, eoding, quality eontrol 
monitoring of interviewers, respondent feedbaek, and interviewer feedbaek. The results of these 
evaluations are presented in this ehapter and were used to inform instrument design for the full- 
seale study. 

4.1 List Quality 

Faeulty lists were evaluated based on the quality and quantity of their eontents. That is, 
lists had to be readable and eontain the needed information for sampling. Table 4.1 provides a 
summary of the eondition of lists reeeived, by institution type. 

Table 4.1 Condition of lists, by type of institution: 2003 



Insufficient information 



Institution type 


Total 


Provided list 


Unreadable 


Sampling^ 


File layout^ 


Total 


150 


134 


2 


36 


67 


Public master’s 


25 


23 


0 


3 


10 


Public baccalaureate 


6 


6 


1 


1 


4 


Public associate’s 


58 


50 


1 


15 


23 


Public other/unknown 


5 


4 


0 


1 


4 


Private not-for-profit master’s 


26 


24 


0 


8 


17 


Private not-for-profit 
baccalaureate 


21 


18 


0 


5 


5 


Private not-for-profit 
associate’s 


3 


3 


0 


1 


2 


Private not-for-profit 
other/unknown 


6 


6 


0 


2 


2 



'“Sampling” refers to not having received a piece of information required for sample selection, such as race or 
gender. 

^“Layout” means the file layout was not received. 

SOURCE: U.S. Department of Education, National Center for Education Statistics, 2004 National Study of 
Postsecondary Faculty (NSOPF:04) field test. 

A number of eonditions had to be satisfied before a submitted list eould pass basie quality 
eontrol eheeks. Fist quality was eheeked by eomparing eounts obtained from tallied faeulty lists 
against those obtained from four supplementary sourees, namely the institution questionnaire, the 
2001 IPEDS Fall Staff Survey the Contaet Information and File Fayout form (whieh ineluded 



IPEDS data used in the field test were from a different academic year and IPEDS uses a different definition of 
faculty than does NSCPF. The 2001 IPEDS Fall Staff Survey classified staff as to primary duties while NSCPF 
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faculty counts), and frame data from the NSOPF:99 survey. Diserepaneies in eounts of full-time 
and part-time faeulty on the tallied faeulty lists and the supplemental sourees that were outside 
the expeeted range were investigated. 

All institutions with submitted lists that failed any eheeks were reeontaeted to resolve the 
observed diserepaneies. Virtually all IPEDS-related diserepaneies were found to be eaused by 
definitional and eoverage differenees between IPEDS and NSOPE. Cognizant of sueh 
differenees, these eheeks were put in place to eateh major list problems (e.g., inadvertent reversal 
of part-time and full-time faeulty eounts by institutions). Upon reeontaeting institutions, lists 
confirmed to be correet and those whose problems were resolved (through resubmission or in- 
house eorreetion) were allowed to proeeed to the sampling stage. Speeifieally, 10 of these 30 
lists were eonfirmed to be eorreet by their eorresponding institutions, 13 problem lists were 
resolved, and 7 remained with a failed status at the end of the eontaet period. These seven 
institutions were not from any speeifie institution type. 

Diserepaneies between tallied list eounts and those reported via institution questionnaires 
were deemed more problematie. Consequently, a more stringent set of eomparison eheeks were 
devised for this purpose. All institutions for whieh their tallied faculty list and institution 
questionnaire eounts were diserepant beyond the thresholds were reeontaeted to resolve the 
observed diserepaneies. Again, many of these diserepaneies were removed after the 
eorresponding institutions eonfirmed the eorreetness of their submitted lists (12 out of 36). A 
number of institutions had to resubmit new lists or provide additional information to eorreet the 
problem (17 of 36). At the end of eontaet period, seven lists remained with a failed tallied 
faeulty list versus institution questionnaire eounts status. 

To quantify the extent of the observed diserepaneies, various diagnostie measures were 
produeed to eapture the relative differenee in faculty counts between tallied lists and the 
supplemental sourees. As shown in table 4.2, of the 150 institutions that provided lists of 
faeulty, 36 failed the eheeks established for eomparison against their institution questionnaires. 

Table 4.2 Discrepancies encountered between tallied faculty list counts and institution 
questionnaire counts, by type of institution: 2003 



Institution type 


Sampled institutions 


Number out of bounds 


Total 


150 


36 


Public master’s 


25 


5 


Public baccalaureate 


6 


2 


Public associate’s 


58 


13 


Public other/unknown 


5 


2 


Private not-for-profit master’s 


26 


6 


Private not-for-profit baccalaureate 


21 


6 


Private not-for-profit associate’s 


3 


1 


Private not-for-profit other/unknown 


6 


1 



SOURCE: U.S. Department of Education, National Center for Education Statistics, 2004 National Study of 
Postsecondary Faculty (NSOPF:04) field test. 



eligibility requirements include all staff who have faculty status or who have instructional duties. Flence, the range of 
acceptable difference between the tallied faculty list counts and IPEDS counts was intentionally broad. 
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Tables 4.3 and 4.4 give the distribution of the relative pereentage diserepaney between 
institution questionnaire eounts and the tallied list eounts for part-time and full-time faculty, 
respectively. The relative percentage discrepancy is measured as the difference between 
institution questionnaire and tallied list counts of faculty divided by the tallied list counts of 
faculty. For instance, 62 percent of institutions provided questionnaires that had a relative 
percentage discrepancy of 0 with tallied lists for part-time faculty, and 86 percent were between 
+ or - 25 percent of each other (table 4.3). Fifty-eight percent of institutions provided 
questionnaires that had a relative percentage discrepancy of 0 with tallied lists for full-time 
faculty and 89 percent were between + or - 25 percent of each other (table 4.4) 

Table 4.3 Number and percentage distribution of institutions by relative percentage discrepancy 
between institution questionnaire and tallied list counts for part-time faculty at the 
institutions, by institution type: 2003 



Institution type 


Number of 




Relative percentage discrepancy (percent) 




institutions 


<-50 


-50 to -26 -25to-1 


0 1 to 25 26 to 50 


> 50 


Total 


118 


4 


3 


12 


62 


12 


3 


4 


Public master’s 


22 


5 


0 


18 


68 


9 


0 


0 


Public baccalaureate 


6 


0 


17 


0 


50 


33 


0 


0 


Public associate’s 


45 


2 


2 


14 


66 


11 


2 


2 


Public other/unknown 


2 


0 


50 


0 


0 


50 


0 


0 


Private not-for-profit master’s 


19 


11 


0 


11 


56 


11 


0 


11 


Private not-for-profit baccalaureate 


17 


6 


0 


12 


59 


12 


6 


6 


Private not-for-profit associate’s 


3 


0 


0 


0 


67 


0 


33 


0 


Private not-for-profit other/unknown 


4 


0 


0 


0 


75 


0 


0 


25 



NOTE: Detail may not sum to totals due to rounding. 

SOURCE: U.S. Department of Education, National Center for Education Statistics, 2004 National Study of 
Postsecondary Faculty (NSOPF:04) field test. 



Table 4.4 Number and percentage distribution of institutions by relative percentage discrepancy 
between institution questionnaire and tallied list counts for full-time faculty at the 
institutions, by institution type: 2003 



Institution type 


Numbpr of . 




Relative percentage discrepancy (percent) 






1 V U 1 1 1 w 1 1 

institutions 


<-50 


-50 to -26 


-25 to -1 


0 


1 to 25 26 to 50 


> 50 


Total 


118 


5 


2 


19 


58 


12 


4 


0 


Public master’s 


22 


0 


0 


18 


64 


9 


9 


0 


Public baccalaureate 


6 


0 


0 


33 


17 


17 


33 


0 


Public associate’s 


45 


5 


0 


27 


57 


9 


2 


0 


Public other/unknown 


2 


0 


50 


50 


0 


0 


0 


0 


Private not-for-profit master’s 


19 


11 


0 


17 


61 


11 


0 


0 


Private not-for-profit baccalaureate 


17 


6 


6 


0 


65 


24 


0 


0 


Private not-for-profit associate’s 


3 


33 


0 


0 


67 


0 


0 


0 


Private not-for-profit other/unknown 


4 


0 


0 


0 


75 


25 


0 


0 



NOTE: Detail may not sum to totals due to rounding. 

SOURCE: U.S. Department of Education, National Center for Education Statistics, 2004 National Study of 
Postsecondary Faculty (NSOPF:04) field test. 



It should be noted that the reported percentages in tables 4.3 and 4.4 are based on very small sample sizes and 
can provide only directional information. 



63 



NSOPF:04 Field Test Methodology Report 






Chapter 4. Evaluation of Data Quality 



Because of small sample sizes, it is impossible to detect specific patterns or differences 
that allow classifications of institutions with respect to specific list problems. Nonetheless, the 
following anecdotal observations are provided based on review of the field test tallied faculty 
lists in comparison with supplemental sources. 

• As expected, due to definitional differences IPEDS counts were often smaller than 
those obtained from the institution questionnaire or tallied faculty lists. This shortage 
was more pronounced for part-time faculty. 

• Institution questionnaire and tallied faculty list counts were relatively more consistent 
with each other, with 89 percent being within + or - 25 percent of each other for full- 
time faculty and 86 percent for part-time faculty. 

4.2 Institution Questionnaire Data Quality 

4.2.1 Item Nonresponse 

Recent studies (for example, DeRouvray and Couper 2002) using web self-administered 
questionnaires have shown higher than usual rates of missing data when the “refuse” and “don’t 
know” options were available on screen. Thus, to limit the rate of nonresponse in the institution 
instrument, the refusal option was not available to respondents and the “don’t know” option was 
limited to selected screens where the respondent might not know the answer. Respondents who 
wished to decline to answer a question were instructed (on the information page at the start of the 
questionnaire) to click the “continue” button to proceed to the next question without answering. 
The exception to this rule was the first item in the institution questionnaire, the count of full- and 
part-time faculty and instructional staff employed by the institution. This item was critical in 
determining the path through the interview; hence, if it were left blank, a warning box appeared 
explaining the importance of the question and the necessity of providing an answer in order to 
continue the questionnaire. 

Only 2 of 83 items in the questionnaire contained more than 10 percent missing data. 
These items are shown in table 4.5. Item nonresponse rates were calculated based on the number 
of sample members asked the question. 



Table 4.5 Institution questionnaire items with more than 10 percent missing data: 2003 



Item 


Description 


Percentage of 
responses missing 


19C 


Undergraduate instruction: number of teaching assistants 


21.9 


19D 


Undergraduate instruction: number of others not covered by the iisted 
categories of staff 


23.7 



SOURCE: U.S. Department of Education, National Center for Education Statistics, 2004 National Study of 
Postsecondary Faculty (NSOPF:04) field test. 



Form (screen) 19 of the institution questionnaire asked respondents to allocate the 
percentage of undergraduate instruction taught by (1) full-time faculty (item 19A), (2) part-time 
faculty (item 19B), (3) teaching assistants (item 19C), and (4) others, such as nonfaculty 
administrators (item 19D). The screen required answers to sum to 0 or 100 percent before the 
respondent could leave the screen. Blank responses were allowed and assumed to be zero when 
sums were calculated. Nonresponse to parts 3 (percentage of undergraduate instruction assigned 
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to teaching assistants) and 4 (percentage of undergraduate instruction assigned to others) had 22 
and 24 percent missing, respectively. However, most of these cases with missing data summed 
to 100 percent on the remaining responses, suggesting that the missing data could safely be 
imputed to zero. Doing so should reduce the rate of missing data for these two items to 4 and 5 
percent, respectively. 

A “don’t know” response option was available for 35 items in the institution 
questionnaire to which “don’t know” was deemed a legitimate answer. These items had to do 
with availability of benefits to full-time and part-time faculty and instructional staff and the use 
of various tools for evaluating teaching assessment. 

The rate of “don’t know” responses was more than 10 percent for four of these items, all 
having to do with teaching assessment, as shown in table 4.6. These high rates of “don’t know” 
responses for these items — 1 1 percent for student test scores (for assessing full-time faculty), 21 
and 17 percent for other measures of student performance (for assessing both full-time and part- 
time faculty, respectively), and 1 1 percent for self-evaluations (for assessing part-time faculty) — 
suggest that there may not be institutional standards regarding what is and what is not used to 
evaluate faculty in various departments. For other measures of student performance, respondents 
may have been unclear what measures might be included in this category. 

Table 4.6 Institution questionnaire items with more than 10 percent “don’t know” data: 2003 



Item Description Percent “don’t know” 



13B 


Full-time faculty assessment: student test scores 


11.4 


13D 


Full-time faculty assessment: other student performance (i.e., 
performance evaluated via other means not listed) 


21.1 


18D 


Part-time faculty assessment: other student performance (i.e., 
performance evaluated via other means not listed) 


16.7 


18H 


Part-time faculty assessment: self-evaluations 


10.5 



SOURCE: U.S. Department of Education, National Center for Education Statistics, 2004 National Study of 
Postsecondary Faculty (NSOPF:04) field test. 



4.2.2 Respondent Feedback 

Individuals completing the institution questionnaire were given the opportunity to 
provide feedback on form (screen) 20. This open-ended question at the end of the questionnaire 
asked for comments, suggestions, or concerns about data collection that would be used to 
improve data collection procedures — in particular, to update the institution questionnaire for the 
full-scale study. 

Of the 114 institutions responding to the institution questionnaire, 21(18 percent) 
provided comments. Several of these institutions provided multiple comments. A total of 29 
comments were evaluated and categorized by type of comment, as shown in table 4.7. The most 
common types of comments were suggestions and clarifications about specific items in the 
questionnaire as well as complaints about the slow response time of the web, difficulties 
accessing the web questionnaire, the instrument “timing out,” and the time it took to compile the 
requested information. Other respondent comments included additional information about who 
provided answers (the last screen also collected contact information for the respondent), pointed 
out inconsistent definitions and inconsistencies between the hardcopy and web questionnaires, 
and complimented the edit checking and ease of data collection. 
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Table 4.7 Summary of respondent comments on the institution questionnaire, by category: 2003 


Comment category 


Number 


Percent 


Total 


29 


100.0 


Specific interview items 


7 


24.1 


Interview length, load time, and web issues 


7 


24.1 


Contact and source information 


5 


17.2 


Consistency with hardcopy questionnaire 


4 


13.8 


Positive comments 


2 


6.9 


Miscellaneous 


4 


13.8 



NOTE: Percentages may not sum to total due to rounding. 

SOURCE: U.S. Department of Education, National Center for Education Statistics, 2004 National Study of 
Postsecondary Faculty (NSOPF:04) field test. 



4.3 Faculty Data Quality 

4.3.1 Reliability of Responses 

The temporal stability of a subset of interview items from the faeulty instrument was 
evaluated through a reinterview. A subset of 26 interview items was seleeted for this 
assessment, targeting items newly designed for the NSOPF:04 interview or items revised sinee 
their use in a previous NSOPF interview. The items seleeted for the reinterview were factual in 
nature rather than attitudinal. The reinterview also provided an opportunity to test for 
differences across mode of administration — that is, to determine whether the temporal stability 
of responses was the same for those who completed the telephone interview and those who 
completed the web self-administered interview. The reinterview was administered in the same 
mode as the initial interview. 

A random sample of 75 web respondents and 77 computer-assisted telephone interview 
(CATI) respondents was selected to participate in the reinterview process. The overall response 
rate was 74 percent. Of the web respondents selected for the reinterview, 53 completed the 
reinterview and 2 completed part of the reinterview, representing a response rate of 73 percent. 
Fifty-eight of the CATI respondents (75 percent) completed the reinterview. The timing of data 
collection appears to have hampered the response rates for the reinterview. The reinterview took 
place at least 4 weeks after the initial interview, which, for many respondents, was after the end 
of their institution’s academic year. To increase the response rate, respondents in the final weeks 
of data collection were offered a $15 incentive to complete the reinterview. 

Responses to items in both the initial interview and the reinterview were compared using 
two measures of temporal stability for all paired responses. The first, percent agreement, was 
based on an exact match between categorical variables. For continuous variables, responses 
were considered to match when their values fell within one standard deviation unit of each 
other. The second measure evaluated temporal stability using Cramer’s V, Kendall’s tau-6 (x*), 
or the Pearson product-moment correlation coefficient (r). Cramer’s V statistic was used for 
items with discrete, unordered response categories (e.g., yes/no responses). Kendall’s tau-6 (x*), 
which takes into account tied rankings,^^ was used for questions that were answered using 

This is equivalent to within one-half standard deviation of the average (best estimate of actual value) of the two 
responses. 

See, for example, Agresti (1984) and Kendall (1945). 
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ordered eategories (e.g., number of classes taught). For items yielding interval or ratio scale 
responses (e.g., income), the Pearson product-moment correlation coefficient (r) was used. Lack 
of agreement or a low relational statistic value for responses typically reflects instability over 
short time periods due to measurement error. To the extent this occurs, items should be deleted 
or revised for the full-scale interview. Conversely, high indices of agreement suggest the 
interview responses were relatively free of measurement errors that could cause response 
instability over short periods of time. 

Effective sample sizes are presented for all results because analyses were restricted to 
cases with determinate responses for an item in both interviews. Sample sizes vary because not 
all items were applicable to all respondents (e.g., numbers of refereed and nonrefereed 
publications in the past 2 years were asked only of those who reported having refereed and 
nonrefereed publications during their career). 

Employment 

The results of the reinterview analyses for the employment items are presented in 
table 4.8. Percent agreement for these items ranged from 70 to 99 percent and was over 96 
percent for all but one item. The relational statistics ranged from 0.66 to 0.98. There were no 
statistically significant modal differences in percent agreement for the employment items. 

The first question of the interview, Q 1 , asked respondents whether they had instructional 
duties at the school in question. Although this item had not been revised for this cycle of 
NSOPF, it was included in the reinterview because it was an essential item for eligibility 
determination and was necessary to set the context for the second question. This item had 96 
percent agreement and the relational statistic was 0.66. Very few respondents reported not 
having instructional duties, which may have skewed the results of the relational statistic. Ninety- 
six percent of the respondents indicated they had instructional duties in the initial interview, and 
97 percent of those provided the same response during the reinterview. 



A skewed distribution of responses may, in some cases, result in a low relational statistic. Similarly, if the number 
of cases is small, the percent agreement and relational statistic should be interpreted with caution. 
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Table 4.8 


Reliability indices for employment: 2003 












Number 


Percent 


Relational 


Item 


Description 


of cases^ 


agreement^ 


statistic^ 


Q1 


Instructional duties. Fall 2002 


113 


96.5 


0.66"^ 


Q2 


Instructional duties related to credit courses/ activities 


104 


97.1 


0.79"^ 


Q5 


Employed full or part time. Fall 2002 


111 


99.1 


0.98 


Q16CD4 


Principal field of teaching-Classification of 
Instructional Programs (CIP) code 4 


108 


70.4 


0.89 



^Analyses were conducted only for respondents with determinate responses on both the initial interview and the 
reinterview; not all questions were applicable to all respondents. 

^This percentage reflects an exact match of the paired responses. 

^Cramer’s V statistic was used. 

"^This relational statistic appears to be deceptively deflated due to insufficient variation across valid response 
categories. As a result, minor changes in the distribution of responses between the initial interview and reinterview 
tend to lower the correlation coefficient. 

SOURCE: U.S. Department of Education, National Center for Education Statistics, 2004 National Study of 
Postsecondary Faculty (NSOPF:04) field test. 

The follow-up question, Q2, determined whether any of these instructional duties were 
for credit. This item was included in the reinterview because the question wording and response 
options had been revised considerably from prior NSOPF interviews. It had 97 percent 
agreement and a relational statistic of 0.79. Again, the skewed distribution, with 93 percent of 
respondents indicating the instructional duties were for credit, may have been the cause of the 
lower relational statistic. 

The question of part-time or full-time employment status, Q5, was included because it 
was considered to be a critical piece of information in the interview. This item had 99 percent 
agreement and a relational statistic of 0.98. Only one respondent reported a different status 
between the two interviews. 

The final employment items included in the reinterview had to do with the principal field 
of teaching. The verbatim string was collected (to set the context in the reinterview), but not 
analyzed. It was then coded into a general area and a specific discipline, provided in drop-down 
boxes (Q16CD4). This system of coding was revised from earlier NSOPF interviews due, in 
part, to the change in mode of administration. To have an exact match, responses needed to 
agree on both general area and specific discipline. They did so for 70 percent of respondents. 

An additional 16 percent matched on general area but not on specific discipline. The relational 
statistic was 0.89. 

An examination of the verbatim strings and codes for cases that did not match on general 
area between the two interviews revealed that about one-half of the fields of teaching could fit 
into multiple categories; did not fit perfectly into a category; or were unclear as to the 
appropriate category, judging from the general descriptions (e.g., English as a second language 
was coded into general categories of English, education, and foreign language). About one- 
quarter of respondents chose the “other” general category in one of the two interviews, despite 
having coded their field of teaching in the other interview. The other recurring issue was that 
some respondents, typically those teaching part-time at 2-year institutions, appeared to be 
teaching courses in multiple areas. It is recommended that the coding process be re-examined 
for the full-scale study (e.g., consider adding a category for “Teaching English as a Second 
Eanguage,” and using an autocoder to improve the coding process). 



NSOPF:04 Field Test Methodology Report 



68 







Chapter 4. Evaluation of Data Quality 



Time Allocation 

Table 4.9 presents the results from the series of time alloeation items. These items 
changed considerably for NSOPF;04 because their format in the past worked well for a hardcopy 
instrument but would have been extremely difficult to administer by CATI. The percent 
agreement, which required responses to be within one standard deviation of each other, ranged 
from 81 to 95 percent. The relational statistics varied considerably, from 0.20 to 0.89. There 
were no significant differences by mode for these items. 



Table 4.9 Reliability indices for time allocation: 2003 







Number 


Percent 


Relational 


Item 


Description 


of cases^ 


agreement^ 


statistic^ 


Q31A 


Hours per week: paid tasks at institution 


111 


95.5 


0.88 


Q31B 


Hours per week: unpaid tasks at institution 


96 


84.4 


0.54"^ 


Q31C 


Hours per week: paid tasks outside of institution 


97 


91.8 


0.81 


Q31D 


Hours per week: unpaid tasks outside of institution 


91 


81.3 


0.20"^ 


Q32A 


Percent time: instructional activities 


109 


80.7 


0.50"^ 


Q32B 


Percent time: research activities 


109 


85.3 


0.58"^ 


Q32C 


Percent time: other activities 


109 


85.3 


0.54"^ 


Q33A 


Percent instructional time: undergraduate 


103 


92.2 


0.73 


Q33B 


Percent instructional time: graduate/first professional 


103 


94.2 


0.89 



^Analyses were conducted only for respondents with determinate responses on both the initial interview and the 
reinterview; not all questions were applicable to all respondents. 

^This percentage reflects an exact match of the paired responses. 

^Pearson’s product-moment correlation coefficient (r) was used. 

"^This relational statistic appears to be deceptively deflated due to insufficient variation across valid response 
categories. As a result, minor changes in the distribution of responses between the initial interview and reinterview 
tend to lower the correlation coefficient. 

SOURCE: U.S. Department of Education, National Center for Education Statistics, 2004 National Study of 
Postsecondary Faculty (NSOPF:04) field test. 

The first question in this series, Q31, required respondents to estimate the number of 
hours per week they spent on paid and unpaid aetivities at the target institution and at any other 
jobs. The hours spent on paid aetivities at and outside the institution had pereent agreement of 
95 and 92 pereent, respeetively, and relational statisties of 0.88 and 0.81, respeetively. The 
pereent agreement for hours spent on unpaid tasks at the institution and outside the institution 
was 84 and 81 pereent, respeetively, and the relational statistics were 0.54 and 0.20, respectively. 
These relatively low relational statistics for unpaid activities may be due to the small values and 
skewed distribution. 

The second question in the series, Q32, required a breakdown of work into percentages of 
time spent on instructional activities, research activities, and other activities. Allocation of time 
for these three types of activities had mixed results. Percent agreement ranged from 81 to 85 
percent, and relational statistics ranged from 0.50 to 0.58. A skewed distribution appears to be 
the reason for these lower relational statistics. 

The third question, Q33, required a further breakdown of instructional activities into 
percentage of time spent on undergraduate instruction and percentage of time spent on 
graduate/first-professional instruction. Allocation of instructional time had percent agreement of 
92 and 94 percent, respectively, and relational statistics of 0.73 and 0.89, respectively. 
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Classes Taught 

Reliability results for the “number of elasses taught” items are presented in table 4.10. 
The percent agreement ranged from 75 to 100 percent, and the relational statistics ranged from 



0.55 to 1.00. No statistically significant differences in 

Table 4.10 Reliability indices for classes taught: 2003 


percent agreement by mode were found. 








Number 


Percent 


Relational 


Item 


Description 




of cases ^ 


agreement^ 


statistic^ 


Q35A1 


Number credit classes taught 




110 


74.5 


0.86 


Q35A2 


Number noncredit classes taught 




103 


88.3 


0.80 


Q35B1 


Number remedial credit classes taught 




102 


90.2 


O.SS"* 


Q35B2 


Number remedial noncredit classes taught 




101 


96.0 


0.81 


Q35C1 


Number distance education credit classes taught 




101 


97.0 


0.85 


Q35C2 


Number distance education noncredit classes taught 


101 


100.0 


1.00 



'Analyses were conducted only for respondents with determinate responses on both the initial interview and the 
reinterview; not all questions were applicable to all respondents. 

^This percentage reflects an exact match of the paired responses. 

^Kendall’s tau-b statistic was used. 

"^This relational statistic appears to be deceptively deflated due to insufficient variation across valid response 
categories. As a result, minor changes in the distribution of responses between the initial interview and reinterview 
tend to lower the correlation coefficient. 

SOURCE: U.S. Department of Education, National Center for Education Statistics, 2004 National Study of 
Postsecondary Faculty (NSOPF:04) field test. 

In NSOPF:99 the total number of classes and the number of classes taught for degree 
credit were collected in questions that were several items apart. For the field test, the numbers of 
for-credit and not-for-credit classes taught were asked on the same screen with modified question 
wording. The responses to Q35A1, the number of classes taught for credit toward a degree, 
ranged from zero to seven classes and had a perfect match between the two interviews in 75 
percent of the cases. An additional 20 percent of the cases differed by one between the initial 
interview and the reinterview. The relational statistic was 0.86. The comparable item for classes 
that were not for credit, Q35A2, had percent agreement of 88 percent and a relational statistic of 
0.80. An additional 9 percent of the cases differed by one between the initial interview and the 
reinterview. 

The NSOPF:99 interview asked how many of the classes were remedial and how many of 
the remedial classes were not creditable toward a degree. In NSOPF:04, these items were 
modified to collect the number of remedial or developmental classes taught for credit (Q35B1) 
and not for credit (Q35B2). Percent agreement was 90 and 96 percent, respectively. The 
relational statistic for the number of remedial for-credit classes was 0.55. Very few of the 
respondents taught remedial courses for credit; this skewed distribution of responses, coupled 
with a small number of changes in the distribution of responses between the two interviews, 
appears to be the cause of the lower relational statistic. The relational statistic for the number of 
remedial not-for-credit classes was 0.81. 

The third pair of items, which asked about continuing education in NSOPF:99, was 
changed to ask about distance education classes. The percent agreement was 97 percent and the 
relational statistic was 0.85 for the number of for-credit distance education classes taught 
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(Q35C1). All responses to the number of not-for-eredit distanee edueation elasses taught 
question (Q35C2) were an exaet mateh. 

Scholarly Activity 

Table 4.1 1 presents the reliability results of the seholarly aetivity items. The pereent 
agreement ranged from 47 to 97 pereent for these items. The relational statistie ranged from 0.32 
to 0.93. There were no statistieally signifioant modal differenees in percent agreement. 



Table 4.11 Reliability indices for scholarly activity: 2003 

Number Percent Relational 

Item Description of cases^ agreement^ statistic 



Q52AA 


Career articles, refereed journals 


111 


97.3 


0.93 


Q52AB 


Career articles, nonrefereed journals 


111 


91.9 


0.78- 


Q52BA 


Last 2 years’ articles, refereed journals 


38 


65.8 


0.75' 


Q52BB 


Last 2 years’ articles, nonrefereed journals 


38 


47.4 


0.55' 


Q55 


Scholarly activity: funded 


98 


52.0 


0.32' 



^Analyses were conducted only for respondents with determinate responses on both the initial interview and the 
reinterview; not all questions were applicable to all respondents. 

^This percentage reflects an exact match of the paired responses. 

^Pearson’s product-moment correlation coefficient (r) was used. 

"^Kendall’s tau-b statistic was used. 

SOURCE: U.S. Department of Education, National Center for Education Statistics, 2004 National Study of 
Postsecondary Faculty (NSOPF:04) field test. 

The “number of publications” items were redesigned for NSOPF:04 because they would 
have been difficult to administer by a telephone interviewer in the matrix form used in the 
NSOPF:99 paper-and-pencil interview. The first pair of items asked about the number of articles 
or creative works published in refereed (Q52AA) and nonrefereed (Q52AB) journals during the 
respondent’s career. These items had percent agreement of 97 and 92 percent, respectively, and 
a relational statistic of 0.93 and 0.78, respectively. 

The second pair of items collected information on the number of articles or creative 
works published in refereed (Q52BA) and nonrefereed (Q52BB) journals in the past 2 years. 

The range of acceptable responses was limited by the respective career total provided in the 
earlier question, and those who did not have publications were not asked these items. The 
responses to the question about number of refereed journal articles in the past 2 years ranged 
from zero to seven and had a perfect match between the two interviews in 66 percent of the 
cases. An additional 26 percent differed by one between the initial interview and the 
reinterview. The relational statistic was 0.75. The responses to the question about number of 
nonrefereed journal articles in the past 2 years ranged from zero to eight and matched perfectly 
between the two interviews in 47 percent of the cases. An additional 24 percent differed by one 
between the two interviews. The relational statistic was 0.55. It should be noted that 
interviewers were instructed to get a “best guess” rather than to require the respondent to provide 
an exact count. It is quite possible, given the time lag between the initial interview and the 
reinterview, that the number of publications they had in the past 2 years may have changed. 

Even though these data are based on a small number of respondents (38) who reached these 
items, the low rate of exact matches suggests this pair of items be considered for revision for the 
full-scale interview. 
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The question of whether scholarly activities were funded was reworded from the 
NSOPF:99 interview and the response options were changed. Feedback from telephone 
interviewers suggested that this item, which asked whether the respondent’s scholarly activities 
were funded, nonfunded, or both, (Q55) was problematic. The results of the reinterview analysis 
reinforced this assessment. The percent agreement for this item was 52 percent and the relational 
statistic was 0.32. Fifteen percent of respondents indicated no scholarly activities in one 
interview and nonfunded activities in the other interview, suggesting they may not have realized 
that “no scholarly activities” was an option (it was not explicitly stated in the question). 
Interviewer feedback indicated that the definition of “funded” was not clear and often resulted in 
backing up to correct the response to this item. It is suggested this item be clarified for the full- 
scale interview. 



Income 

The results of the reinterview analyses for the income items are presented in table 4.12. 
The percent agreement was over 95 percent for both items and the relational statistics ranged 
from 0.87 to 0.97. There were no significant differences by mode in percent agreement for the 
income items. 



Table 4.12 Reliability indices for income: 2003 



Item 


Description 


Number 
of cases^ 


Percent 

agreement^ 


Relational 

statistic^ 


Q66AA 


Income: basic salary from institution 


105 


98.1 


0.97 


Q66AB 

1 A . 


Income: other income from institution 


108 


95.4 


0.87 



reinterview; not all questions were applicable to all respondents. 

^This percentage reflects an exact match of the paired responses. 

^Pearson’s product-moment correlation coefficient (r) was used. 

SOURCE: U.S. Department of Education, National Center for Education Statistics, 2004 National Study of 
Postsecondary Faculty (NSOPF:04) field test. 



Separate income amounts were requested for basic salary from the target institution 
(Q66AA) and other compensation from this institution not included in the basic salary (Q66AB). 
Basic salary from the institution had 98 percent agreement and a relational statistic of 0.97. 

Other compensation from the institution had percent agreement of 95 percent for this item. The 
relational statistic for this item appears to be slightly deflated due to the large number of 
responses clustered at zero. 

4.3.2 Inconsistent Responses 



In order to improve data quality, resolution screens were programmed throughout the 
instrument to identify and enlist the respondents’ help in resolving inconsistent data. The 
instrument included seven resolution screens that explained to respondents that their answers 
were in conflict, then briefly described the items in question and the corresponding responses. 
Respondents had the option of clicking on a “change” button for each of the items that would 
route them back to the screen in question to change their answer. Alternatively, if respondents 
wanted to keep the answers, they could proceed to the next question by selecting the “continue” 
button. 
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The first resolution screen checked for inconsistent employment data. The number of 
years the respondents reported working part time at the target institution (Q7) was compared 
with the year in which they started working at the job held at the institution (Q9). If the current 
year minus the year in which the respondents started working at the job was less than the number 
of years they had worked part time, the resolution screen was displayed. Of the 401 respondents 
who responded to both employment questions, 12 had inconsistent data after having the 

3 1 

opportunity to correct it on the resolution screen. 

The second resolution screen tested for inconsistencies in dates degrees were awarded. 
The year respondents were awarded their highest degree (Q17A2) was compared with the year 
the respondents reported earning a bachelor’s degree (Q17D). The resolution screen was 
launched if the bachelor’s degree year was not less than the year the highest degree (master’s, 
professional, or Ph.D.) was awarded. Of the 772 respondents who responded to both questions, 
three had inconsistent data after having the opportunity to resolve the inconsistency on the 
resolution screen. 

An age check was performed against degree dates after respondents’ year of birth was 
collected. The ages at which the respondents reported earning their highest degree (Q17A2), 
doctoral degree (Q17C), and bachelor’s degree (Q17D) were compared with the respondents’ 
year of birth (Q72). The resolution screen came up for 1 1 respondents when the calculated age 
at earning any of the degrees was less than 20. Five respondents resolved the conflict with age 
and six did not, although their data may, in fact, be accurate. Five indicated they earned a 
bachelor’s degree at a young age (one at age 13, one at 17, one at 18, and two at 19), and the 
other indicated having received an associate’s degree at age 19. 

The next resolution screen checked for inconsistencies in the number of postsecondary 
jobs reported. The sum of the numbers of full- and part-time faculty and instructional staff 
positions held at other postsecondary institutions during the 2002 Fall term (Q19B1 and Q19B2) 
was compared with the total number of postsecondary institutions where the respondent had been 
employed as a faculty or instructional staff member (Q22). The resolution screen appeared if 
respondents reported holding more concurrent positions at postsecondary institutions during the 
2002 Fall term than the total number of positions held at postsecondary institutions during their 
career. Of the 157 respondents who responded to both questions, three had inconsistent data. 

To resolve inconsistent employment history data, the year the respondents started 
working at the job they held during the 2002 Fall term (Q9), the year in which respondents 
attained their current academic rank (Q1 1), and the year the respondents first achieved tenure 
(Q13) were checked against the year they began their first faculty position at a postsecondary 
institution (Q23). The resolution screen was displayed if the year a faculty member began the 
first faculty position was greater than any of the years it was compared against. Four 
respondents reached the inconsistent-data screen and all but one resolved the inconsistency. 



Four of the resolution screens used a generic resolution screen that did not set a flag to indicate that the resolution 
screen was reached. Thus, there is no way to know how many of these 401 respondents reached the resolution 
screen and corrected their answers. The other three resolution screens described in this section were customized to 
handle the resolution of more than two pieces of conflicting data. Because of this customization, these resolution 
screens included time stamps, which were used as an indicator that the screen was reached. 



73 



NSOPF:04 Field Test Methodology Report 






Chapter 4. Evaluation of Data Quality 



The age at which the respondents expected to stop working at a postsecondary institution 
(Q63) was compared with the age at which they expected to retire from all paid employment 
(Q65). The resolution screen came up when respondents reported an older age for retiring from 
postsecondary employment than for retiring from all paid employment. Of the 908 respondents 
who answered both questions, 4 had inconsistent data after having had the opportunity to correct 
it on the resolution screen. 

A second check on expected age at retirement came up after respondents’ year of birth 
was collected. The age at which respondents expected to stop working at a postsecondary 
institution (Q63) and the age they expected to retire from all paid employment (Q65) were 
checked against year of birth (Q72) for inconsistencies. The resolution screen appeared for 12 
respondents whose year of birth indicated they were older than one of the ages projected for 
retirement. All 12 respondents resolved their inconsistent data. 

4.3.3 Item Nonresponse 

As mentioned earlier, web self-administered studies that include “don’t know” and 
“refuse” options on screen tend to have higher rates of missing data. To limit the rate of 
nonresponse in the faculty instrument, the refusal option was not available to respondents and the 
“don’t know” option was limited to selected screens where the respondent might not know the 
answer (e.g., expected age at retirement). Respondents were instructed (on the information page 
at the start of the questionnaire) to click the “continue” button to proceed to the next question if 
they wished to decline to answer a question. For a small number of screens requesting critical 
information, a warning box appeared explaining the importance of the question, thus 
encouraging the sample member to provide an answer. 

Missing Data 

Eleven of the approximately 250 items in the faculty questionnaire contained more than 
10 percent missing data. These items are reported in table 4.13, broken out by mode of data 
collection. Item nonresponse rates were calculated based on the number of sample members of 
whom the item was asked.^^ 

The IPEDS school coding system collected the state, city, and name of the school that 
awarded the respondent’s highest degree (Q17A4) and that information was matched, real time, 
against the IPEDS database. The name of the school was missing for 10 percent of the sample. 
Web respondents were more likely to leave this item blank than CATI respondents (15 percent 
versus 3 percent; = 33.7, /><0. 0001). This screen was complicated to administer and telephone 
interviewers therefore received specific training on it. Web respondents may have had difficulty 
interpreting the coding instructions provided. In addition, this screen required respondents or 
interviewers to choose a “search” button instead of the more familiar “continue” button to 
properly code the school; data for some web respondents was not saved because they incorrectly 
used the continue button, despite a pop-up box requesting they use the search button. 

Some items that appear to have high rates of missing data (-9) in the field test data actually have a lower incidence 
of missing data. This is due to the coding of nested items as missing (rather than skipped, -3) in the data when the 
respondent did not answer the gate question. For the purpose of the item nonresponse analysis, if respondents did 
not reach an item because they did not answer an earlier question, the missing answer was removed from the 
calculation of nonresponse for that item. 
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Table 4.13 Faculty questionnaire items with more than 10 percent missing data: 2003 



Percent 



Item 


Description 


Total 


Web 


CATI 


Q17A4N 


Highest degree institution — name 


10.1 


14.8 


2.8 


Q19B1 


Number full-time positions at other postsecondary institutions 


13.4 


19.5 


5.3 


Q19B2 


Number part-time positions at other postsecondary institutions 


11.4 


18.0 


2.7 


Q31C 


Hours/week: paid tasks outside institution 


11.7 


18.4 


1.1 


Q31D 


Hours/week: unpaid tasks outside institution 


14.7 


22.9 


1.7 


Q37F3 


Teaching assistant, third class^ 


12.0 


17.6 


0.0 


Q37F4 


Teaching assistant, fourth class^ 


14.0 


20.7 


0.0 


Q47B3 


Individual instruction: first-professional hours 


15.8 


19.2 


8.3 


Q59 


Scholarly activity: number grants/contracts 


28.0 


18.1 


46.2 


Q62C 


Satisfaction: benefits 


10.7 


4.3 


20.7 


Q66B 


Total income (nonresponse follow-up; range)^ 


30.7 


27.5 


33.4 



'Respondents were asked about up to eight classes that they taught, but few respondents taught more than four. 
^This item was asked only of those who did not answer the income questions on the previous form. Overall, the 
nonresponse for income was 2 percent. 

SOURCE: U.S. Department of Education, National Center for Education Statistics, 2004 National Study of 
Postsecondary Faculty (NSOPF:04) field test. 

The questions regarding the number of full- and part-time faculty jobs held at other 
postsecondary institutions during the 2002 Fall term (Q19B1 and Q19B2) had “missing” rates of 
13 and 1 1 percent, respectively. For both items, web respondents were more likely to leave 
answers blank than were CATI respondents (20 percent versus 5 percent, x = 15.0,/><0.0001; 

18 percent versus 3 percent, x^ = 20.1,/><0.0001). The majority of respondents who did not 
provide an answer to the number of full-time jobs did answer the number of part-time jobs held 
during the fall term, and vice versa, suggesting the blank answers are implied zeroes. CATI 
interviewers were trained to enter zeroes rather than leave an item blank, which may account for 
the missing data mode effect for these items. If these blanks are indeed implied zeroes, the 
actual “missing” rate for both full- and part-time jobs held was 1 percent. 

Questions about paid and unpaid job-related activities performed outside the institution 
during the fall term (Q31C and Q31D) had missing data rates of nearly 12 and 15 percent, 
respectively. Web respondents were more likely to leave answers blank than CATI respondents 
(Q3IC: 18 percent versus I percent, x^= 62.9,/><0.000I; Q3ID: 23 percent versus 2 percent, x^ = 
78.1, /><0. 0001). A check against questions indicating whether respondents had employment 
outside their institutions (such as Q18, other jobs excluding consulting; and Q66AD, amount of 
consulting income) suggests that about half of these cases did not have any other employment; 
hence, their blank answers to these items are implied zeroes. Additionally, of the 154 
respondents who did not answer Q31C or Q31D, 97 percent provided information about paid 
(Q31A) or unpaid (Q3 IB) job-related activities performed at the institution during the fall term 
giving further credence to the speculation that the missing data at Q31C and Q31D were implied 
zeros. 



The matrix items that asked about the use of teaching assistants (Q37F3 and Q37F4) had 
“missing” rates of 12 and 14 percent for the third and fourth classes described, respectively. 
Web respondents were significantly more likely to leave this item blank for the third class than 

“ Respondents were asked about up to eight classes that they taught, but few respondents taught more than four. 
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were CATI respondents (18 pereent versus 0 percent, x = 4.8,/><0.05). The difference was not 
statistically significant for the fourth class (21 percent versus 0 percent, 3.4, p=0.07). 
Respondents may have grown tired of providing detailed information about their classes and 
therefore left these items blank. 

The item asking the number of hours of individual instruction time respondents had with 
their first-professional students during the fall term (Q47B3) was blank for nearly 16 percent of 
respondents who indicated they had individual instruction with first-professional students. It 
should be noted this item was asked of only 38 respondents. Providing the number of contact 
hours for individual instruction of first-professional students may have been difficult for 
respondents, particularly if the individual instruction was not on a formal schedule. 

The item asking for the number of grants or contracts the sample members had in the 
2002-03 academic year (Q59) was missing for 28 percent of those who indicated they had 
funded research. CATI respondents were significantly more likely than web respondents to 
leave this item blank (46 percent versus 18 percent, 23.6, /><0. 0001). Based on feedback 
from interviewers (reported later in this chapter), the “funded scholarly activity” was not clearly 
defined as grants and/or contracts in the gate question (Q55). Therefore, CATI respondents 
reported not having any grants or contracts when they answered this question, which was not an 
allowable answer. 

Satisfaction with benefits from the target institution (Q62C) was missing for nearly 1 1 
percent of the sample. CATI respondents were more likely than web respondents to leave this 
item blank (21 percent versus 4 percent, x^= 60.5, /><0. 0001). The overwhelming majority of the 
sample members who did not answer this question were part-time faculty and instructional staff. 
This suggests the institution did not provide them with benefits and therefore they could not 
answer the question. This explanation was confirmed by interviewers during the interviewer 
debriefing. 

Sample members’ total compensation from all sources (in categories; Q66B) was missing 
for 3 1 percent of those reaching this item. There was no difference in nonresponse by mode. 

This question was asked only when respondents did not provide answers to one or more of the 
questions about compensation from the institution and other sources on the previous screen 
(Q66). In other words, this item attempted to convert nonresponse to a sensitive income item. 
Despite this high rate of nonresponse, this item was effective in converting nonresponse. 
Together these two screens soliciting amount of income garnered responses from 98 percent of 
the sample. 

“Don’t Know” Responses 

A “don’t know” response option was available for six items in the faculty questionnaire 
to which “don’t know” was considered to be a legitimate answer. Table 4.14 summarizes the 
rates of “don’t know” responses to these items. 
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Table 4.14 Faculty questionnaire items with “don’t know” responses: 2003 



Percent 



Item 


Description 


Total 


Web 


CATI 


Q60A 


Scholarly activity: grants/contracts funding amount 


23.4 


31.1 


9.9 


Q60B 


Scholarly activity: grants/contracts funding amount (range) 


24.2 


22.5 


30.0 


Q63 


Age expecting to retire from postsecondary employment 


35.2 


46.5 


17.6 


Q65 


Age expecting to retire from all paid employment 


37.1 


50.1 


16.7 


Q70A 


Income: total household 


13.3 


17.3 


7.1 


Q70B 


Income: total household (range) 


15.2 


19.0 


7.9 



SOURCE: U.S. Department of Education, National Center for Education Statistics, 2004 National Study of 
Postsecondary Faculty (NSOPF:04) field test. 



The “don’t know” option on the question asking for the amount of funding for grants and 
eontraets (Q60A) was ehosen by 23 pereent of those with funded scholarly activities. Web 
respondents were more likely to use the “don’t know” option than were CATI respondents (31 
percent versus 10 percent, x = 16.1, j2<0. 0001). This is not surprising since the “don’t know” 
option was visible to web respondents whereas CATI respondents were not read that response 
option. CATI interviewers were also trained to encourage respondents to provide a “best guess” 
of the amount. The follow-up question, for those who did not provide an amount, asked for the 
amount of funding with ranges as response options (Q60B). Nearly one-quarter of those who got 
this item responded with “don’t know.” Of those who answered “don’t know” to the first 
question, 63 percent chose a categorical response option to the follow-up question. Together, 
these questions collected a funding amount from 88 percent of those who received funding for 
their scholarly activities. 

The two questions asking the ages at which sample members plan to retire from 
postsecondary education (Q63) and all paid employment (Q65) provided “don’t know” response 
options. Thirty-five percent of respondents were unsure at what age they would retire from 
postsecondary employment and 37 percent of respondents did not know at what age they would 
retire from all paid employment. Given that the average age of all respondents was 48 years, it is 
not surprising that many of these respondents were unwilling to specify an exact age. Web 
respondents were more likely than CATI respondents to select the “don’t know” option (Q63: 47 
percent versus 18 percent, 'i= 79.1, /><0. 0001; Q65: 50 percent versus 17 percent, 'i = 103.0, 
/><0.0001). Again, this difference by mode of data collection may be attributed to the option 
being visible to web respondents while CATI interviewers were encouraged to probe for the best 
answer. 



The questions about household income also had high “don’t know” access rates. Thirteen 
percent of respondents said that they did not know their total household income (Q70A) and an 
additional 7 percent left the item bla nk . Web respondents were more likely than CATI 
respondents to answer “don’t know” to this item (17 percent versus 7 percent, 'i =19.5, 
/><0.000I). Those who did not answer or said they did not know were asked a follow-up 
question with ranges for providing household income (Q70B). Sixty-nine percent provided a 
response to the follow-up question. Together, these questions collected the total household 
income from 94 percent of respondents. 
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4.3.4 Item Mode Effects 

A goal for the NSOPF:04 field test was to minimize potential mode effeets by designing 
a single instrument to be used for both self-administration and CATI, and by eliminating the 
paper version of the survey used in previous NSOPF cycles. However, whenever multiple 
modes are used for data collection, the possibility of mode effects is inherent. Because 
respondents were offered the option of completing the interview by themselves on the web or 
with an interviewer, there was the potential for bias due to self-selection or other variables for 
which we cannot account. Therefore, these results should be interpreted as how respondents in 
different modes of administration answered the survey questions, and not as true mode 
differences. 

For this analysis, 63 variables were selected, covering the following topic areas: 
demographic variables, descriptive items, factual items, and opinion-based questions. Criteria 
for selection of items included importance to the content of this study. Items for which project 
staff had concerns that there might be mode effects (e.g., complex matrix items) were also 
selected. 

Demographics 

Compared to their CATI counterparts, web respondents were more likely to be male 
(Q71; 56 percent versus 47 percent, =1 .05, p<0.0l), younger (Q72; mean age 48 versus mean 
age 51, t=3.48, /><0.001), and White (Q74; 92 percent versus 88 percent, z =!.96,/><0.05). 
Conversely, Blacks or African Americans (Q74) were a larger proportion of CATI completed 
cases than of web completed cases (9 percent versus 5 percent, z = -2.3,/><0.05). 

Descriptors 

Web respondents were more likely than CATI respondents to report administration as 
their primary activity (Q4: 7 percent versus 4 percent, z =2.59,/><0.0I), be employed full-time 
(Q5: 61 percent versus 48 percent, z = 3.85, /><0. 001), be an associate professor (QIO: 15 percent 
versus 8 percent, z = 3.14,/»<0.01), and be tenured (Q12: 31 percent versus 23 percent, z = 2.58, 
/><0.01). CATI respondents were more likely than web respondents to be instructors (QIO: 37 
percent versus 23 percent, z = -4.57, /><0. 001), not on tenure track (Q12: 54 percent versus 44 
percent, z = -2.90,/><0.01), and employed outside the target institution (Q18: 43 percent versus 
36 percent, z = -2.\2,p<0.05). 

Factuai items 

Thirty-six factual items were chosen, based on their importance to the study objectives. 
These factual items were expected to show few, if any, mode differences. These questions 
centered on eight main topic areas: number of classes taught, year began teaching, employment 
sector of previous job, hours per week spent on various tasks, percent time spent on various 
tasks, use of various methods in the classroom, other activities, and publications. 

Classes taught. There were no significant differences observed in mean number of 
classes taught full time or part time at other postsecondary institutions (Q19C1 and Q19C2), or 
mean number of credit and noncredit classes taught at the target postsecondary institution 
(Q35A1 and Q35A2). 
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Year began teaching. There was no signifieant difference in the mean year web 
respondents began teaching (Q23) compared to their CATI counterparts. 

Employment sector of previous job. CATI respondents were more likely to have been 
employed in an elementary or secondary school prior to their current position (Q28) than were 
web respondents (19 percent versus 13 percent, z = -2.20,/><0.05). 

Hours per week spent on various tasks. Web respondents reported spending more time 
on paid tasks at the institution (Q31A), on average, than their CATI counterparts (31 hours 
versus 27 hours, t=3.27, /><0.001). No significant differences were found on hours spent on 
unpaid tasks at the institution (Q31B), paid tasks outside the institution (Q31C), unpaid tasks 
outside the institution (Q31D), or hours spent e-mailing students each week (Q41). 

Percentage of time spent on various tasks. Respondents were asked to provide the 
percentage of time they spent on instructional activities (Q32A), research activities (Q32B), and 
other activities (Q32C); and were further asked to break down these activities. No significant 
differences were observed between web and CATI respondents in reports of percentage of time 
spent overall on instructional activities, research activities, and other activities. However, within 
other activities, web respondents reported spending a greater percentage of their “other” time, on 
average, on administration (Q34A) than their CATI counterparts (47 percent versus 30 percent, 
t=6.54,/»<0.001). Compared to web respondents, CATI respondents reported spending a greater 
percentage of their “other” time on service (Q34C: 22 percent versus 17 percent, t= -2.91, 
/><0.01) and other activities (Q34D; 21 percent versus 1 1 percent, t= -4.67, /><0. 001). 

Use of various methods in the classroom. Of the 1 1 methods in question, only 2 
showed a significant difference by mode. CATI respondents were more likely to report using 
essay midterm or final exams (Q38C) than were web respondents (66 percent versus 57 percent, 
z = -2.41,/»<0.05). Web respondents were more likely to report using a website for instructional 
duties (Q39) compared to CATI respondents (50 percent versus 41 percent, z = 2.61,/><0.01). 

Other activities. There were no significant differences in reports of how often web and 
CATI respondents met with other instructional faculty to plan instruction (Q43A), talked with 
students about their career plans (Q43B), met with business or industry representatives to 
develop a curriculum (Q43C), or called or met with business or industry representatives to 
develop employment opportunities for students (Q43D). 

Publications. The average number of articles published in refereed journals in their 
careers (Q52AA) was no different for web and CATI respondents. 

Opinion 

Thirteen opinion-based questions were evaluated for mode differences. Eight of these 
questions asked how satisfied respondents were with various aspects of their job, including: 
authority to make decisions, technology-based activities, equipment/facilities, institutional 
support for teaching improvement, workload, salary, benefits, and job overall (Q61 and Q62). 

As shown in table 4.15, CATI respondents were significantly more likely to report being either 
somewhat or very satisfied with six of the eight items — including their authority to make 
decisions, equipment and facilities, institutional support for teaching improvement, workload. 
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salary, and job overall — compared to web respondents. These differences may be due to the 
effect of social desirability on responses when an interviewer is involved. 

Table 4.15 Satisfaction items, by mode of administration: 2003 



Web CATI 



Item 


Description 


Number 


Percent 


Number 


Percent 


Q61A 


Authority to make decisions 


494 


92.5 


335 


97.7** 


Q61C 


Equipment/facilities 


374 


69.8 


279 


81.3*** 


Q61D 


Institutional support for teaching improvement 


320 


61.8 


258 


79.4*** 


Q62A 


Workload 


417 


75.4 


291 


82.9** 


Q62B 


Salary 


339 


61.6 


244 


69.5* 


Q62D 


Job overall 


490 


88.5 


328 


93.7** 



*p<0.05, **p<0.01, ***p<0.001. 

SOURCE: U.S. Department of Education, National Center for Education Statistics, 2004 National Study of 
Postsecondary Faculty (NSOPF:04) field test. 



The remaining five opinion-based questions asked respondents to indicate whether they 
agreed or disagreed that teaching was rewarded, part-time faculty were treated fairly, female 
faculty were treated fairly, and racial minorities were treated fairly (Q82); and whether they 
would choose an academic career again (Q83). There were no significant differences in reports 
of agreement between web and CATI respondents for any of these questions. This may, 
however, be due in part to the lack of variance on these questions overall. 

4.3.5 Breakoffs 

A total of 959 sample members started the faculty interview. Twenty of these were 
deemed ineligible based on their responses to the questions about instructional duties (Ql) and 
faculty status (Q3), and exited the interview. Of the 939 eligible sample members, 908 
completed the entire interview and 3 1 (3 percent) broke off at some point in the interview. Of 
the 3 1 respondents who broke off, 6 did so in the employment section (A), 5 in the academic 
section (B), 14 in the workload section (C), and 6 in the scholarly activities section (D). The 6 
respondents who broke off after completing the workload section (C) were considered partial 
completes. 

4.3.6 Use of Help Text 

Help text was available for every screen in the field test faculty instrument to assist 
respondents and telephone interviewers while conducting an interview. The help text displayed 
the purpose of the question, definitions of words or phrases referenced in the question or 
response options, and any additional information or instructions needed to accurately answer the 
question. The toll-free number and e-mail address of the help desk was also included in the help 
text for each screen, so web respondents had a contact if additional help was needed. In addition 
to the item-level help, a general help screen was available to answer technical questions. The 
general help screen provided assistance on web browser requirements as well as explanations of 
the radio buttons, text boxes, and drop-down boxes used for entering responses. 

Counters were used to determine the number of times each help screen was accessed, 
making it possible to identify items that were confusing to interviewers or respondents. Of the 
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113 forms (screens) in the faeulty interview, 9 had help-text aeeess rates greater than 10 pereent. 
These forms with high rates of help-text aeeess, summarized in table 4.16, were then analyzed by 
mode to determine whether any issues assoeiated with the screen were related to the mode of the 
interview. 

Table 4.16 Faculty questionnaire items with more than 10 percent usage of help text: 2003 



Percent 



Form 


Description 


Total 


Web 


CATI 


Q3 


Faculty status. Fall 2002 


13.0 


10.4 


17.2 


Q31 


Hours per week: paid/unpaid tasks, all jobs 


11.4 


2.5 


25.4 


Q35B 


Number credit/noncredit remedial classes taught 


18.3 


15.6 


22.4 


Q35C 


Number credit/noncredit distance education classes taught 


11.9 


4.6 


23.3 


Q45 


Professional training hours, calendar year 2002 


12.0 


5.3 


21.7 


Q47B 


Individual instruction: number of contact hours 


11.9 


4.3 


21.5 


Q52A 


Career publications/presentations 


13.4 


1.8 


31.6 


Q55 


Scholarly activity: funded 


11.2 


4.4 


21.5 


Q59 


Scholarly activity: number grants/contracts 


13.7 


6.2 


26.7 



SOURCE: U.S. Department of Education, National Center for Education Statistics, 2004 National Study of 
Postsecondary Faculty (NSOPF:04) field test. 



Q3. This critical item in determining respondent eligibility asked, “During the 2002 Fall 
term, did you have faeulty status at [institution name]?” This form had a high rate of help-text 
hits for both self-administered and CATI respondents. Sample members who aceessed help text 
for this form tended to be part-time respondents (Q5), suggesting that they were unsure whether 
they were considered to be faeulty members and may have been looking for a definition of 
faeulty. 



Q31. This form asked for the number of hours the respondent worked at paid and unpaid 
activities at the target institution and the number of hours worked at paid and unpaid aetivities at 
any other jobs. Help-text aceesses for this form were overwhelmingly made by CATI 
interviewers. During the interviewer debriefing at the end of data eolleetion (see later seetion 
summarizing the debriefing), interviewers reported that faculty and instructional staff asked for 
specifie examples of what was ineluded in “unpaid professional serviee” and noted that sample 
members’ ideas of what eonstituted paid and unpaid aetivities often differed from the examples 
provided on sereen. 

Q35B, Q35C. The first of these forms asked, “Of the classes you taught at [institution 
name] in the 2002 Fall term, how many were remedial or developmental elasses?” The other 
asked, “Again, thinking about all the elasses you taught in the 2002 Fall term at [institution 
name], how many elasses did you teaeh through distance edueation, either exelusively or 
primarily?” One reason for the high rate of help-text hits on these forms is that there was an 
on-sereen instruetion direeting web respondents and interviewers to select the help button for 
additional guidanee on how to eount elasses. Feedbaek from interviewers indieated that the 
terms “developmental” and “distanee edueation” required clarifieation for some respondents. 
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Q45. This form asked, “How many hours during the 2002 ealendar year did you spend in 
training or professional development?” Interviewers reported that respondents found the 
timeframe (ealendar year) difficult. Help text may also have been reviewed to determine what 
sorts of activities to include or exclude when answering the question. 

Q47B, This form asked, “Of the students who received individual instruction from you 
during the 2002 Fall term, what was the total number of contact hours you had each week with 
your [undergraduate/graduate/first-professional students]?” The level of students asked about 
was based on the response to the previous question, which asked whether they had individual 
instruction with students at each of these levels. One explanation for the high rate of help-text 
accesses had to do with confusion over what was meant by the terms “individual instruction,” 
“first-professional,” and “contact hours.” 

Q52A. One of the more complex forms in the instrument, this screen asked for the 
number of career publications and presentations. Interviewers reported confusion over whether 
the term “career” meant their career as a teacher or their entire lifetime of work. Help text may 
also have been used for clarification of where to classify certain types of publications. 

Q55 and Q59. This form asked about funding of scholarly activities, with Q55 serving 
as a gate for Q59. Q55 asked, “During the 2002-03 academic year, were your scholarly 
activities at [institution name] funded, nonfunded, or both funded and nonfunded?” There 
appear to have been two reasons for accessing help text on this form. First, interviewers used the 
help text to provide the definition for “scholarly activities” as needed. The most frequent reason 
for accessing the help text, according to interviewer feedback, was a common misunderstanding 
of what constitutes “funded,” particularly with respect to the follow-up question, Q59. Q59 
asked, “How many grants/contracts did you have from all sources in the 2002-03 academic 
year?” Interviewers reported many sample members answering “zero,” which was not an 
allowable answer. Help text was amended to direct respondents to return to Q55 and change 
their answer if they did not have any funded grants/contracts. 

4.3.7 Coding “Other, Specify” Items 

Four screens in the faculty interview included an “other, specify” option in addition to 
their fixed response options. Typically, the “other, specify” option is provided for items whose 
response categories may be incomplete. This option may be selected when the respondent’s 
answer does not fit into one of the existing response categories and a text string with more 
information can be entered. 

Upcoding — that is, attempting to code these text strings into existing categories — ^was 
done by project staff. In some cases the text string could be upcoded into an existing response 
option. The text strings that could not be upcoded were analyzed to determine whether new 
response options should be added for the full-scale study. 

Q34. This question, administered to those who indicated they had work activities other 
than instruction and research, asked “Finally, of the time you spent on activities other than 
instruction and research during the fall term at [institution name] or any other institution, what 
percentage did you spend in the following four areas: administration, professional growth, 
service, and other activities not related to research and instruction and not included above? What 
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percentage of your nonresearch and nonteaching time did you spend on. . Approximately 
one-quarter of respondents indicated they spent time on “other” activities and specified what 
those activities were. While some of the text strings could be coded as instructional activities 
(i.e., advising students, teaching, preparing for class), the majority of “other, specify” strings did 
not fit into the categories listed.^"^ Respondents appear to have misinterpreted the meaning of this 
question, often reporting their personal activities (e.g., family activities, sports, faith-related 
activities). 

Q40. This question asked, “How did you use the websites for your instructional 

-5 c 

activities?” A total of 76 strings were collected, 61 percent of which were upcoded into an 
existing category. The largest number of strings was upcoded to the Q40A response category, 
“To facilitate communication with and between students.” The most common answers that were 
upcoded into this category included the following: to answer students’ e-mail questions; to 
provide feedback; to deal with general communication; to hold discussions or host discussion 
boards; and to provide announcements or reminders to students. The second largest response 
category to be upcoded was Q40B, “To provide content.” The most common answers that were 
upcoded included the following: online references/links to research; instructional 
materials/course reading; PowerPoint presentations; and lecture notes/lecture material. Since 
most of the text strings corresponded to examples provided on screen, it may be beneficial to 
have interviewers read those examples to respondents so they have a clearer understanding of 
what is included in each response category. One frequent response that could not be upcoded 
was “research.” 

Q44, This question asked, “During the 2002 calendar year, did you use training or 
professional development resources provided by your department or institution to. . .a) develop 
new or improved curriculum, b) learn how to use new instructional practices, c) learn how to 
better use educational technology, d) learn how to use student performance data to improve 
curriculum or teaching, e) keep up with skills and knowledge required of your students in the 
workplace, f) other, please specify?” Eleven percent of the text strings were upcoded into an 
existing category. Since the text strings often referenced specific types of technology training 
(i.e., classroom equipment or instructional media workshops), it is recommended that in the full- 
scale study, examples of educational technology be included in the item wording, where 
appropriate. 

Q68. This question, administered to those not on a 9-, 10-, 1 1-, or 12- month contract, 
asked, “What was the basis of your pay? Was it by. . .course, credit hour, academic term, or 
other, please specify?” Twenty-one percent of the text strings were upcoded into an existing 
category. Based on these upcoded strings, it is recommended that “(semester/quarter/trimester)” 
be added to the response option “academic term.” Two frequent responses (40 percent of text 
strings provided) that could not be upcoded into existing categories were “student” and 
“hour/hourly rate.” 



Actual upcoding was impossible for this item because the responses were percentages rather than indicators of 
whether they did the activity or not. Nevertheless, the text strings were analyzed to determine whether additional 
items should be added to the form. 

The gate question for this item asked “During the 2002 Fall term at [institution name], did you have one or more 
Internet websites or network sites for instruction, materials exchange, or other purposes for any of your teaching, 
advising, or other instructional duties?” 
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4.3.8 Classification of Instructional Programs (CIP) Coding 

The NSOPF field test instrument ineluded tools that allowed online coding of literal 
responses for field of teaching, field of research, and field of highest degree. The codes for each 
of these fields were identical (see appendix F for a list of codes). The literal string was first 
coded into a general category from the 32 categories provided in a drop-down box. It was then 
coded into a specific category within the general category. There were a total of 137 specific 
categories, but within a general category there were never more than 18 specific categories to 
choose from. 

The anticipated benefit to performing this coding in the interview for web respondents is 
obvious; the sample member can see the categories and select the appropriate general and 
specific categories. For telephone-administered interviews, this real-time coding may also 
improve data quality by capitalizing on the availability of the respondent to clarify coding 
choices at the time the coding was performed; interviewers were trained to use probing 
techniques to assist in the coding process. 

As part of the field test data evaluation activities, a random sample of 10 percent of the 
results for each of the three CIP codings (teaching, research, highest degree) was selected. An 
expert coder evaluated the verbatim strings for completeness and for the appropriateness of the 
assigned codes, determining whether a string was too vague to code or whether a different code 
should be assigned. 

Overall, 69 percent of those sampled for recoding were coded correctly, 2 1 percent were 
incorrectly coded, and 10 percent of the strings were too vague to determine whether they were 
correctly coded. Table 4.17 shows the results of the 10 percent recode, by mode. There were no 
mode differences in the coding results; the expert coder agreed with web respondent coding at 
about the same rate of agreement as with CATI interviewer coding (x =0.56, p=.76). 

Table 4.17 Summary of 10 percent recoding of CIP: 2003 

Web respondents CATI respondents 

Classification Percent Percent 

of Instructional Coding Percent too Coding Percent too 



Programs (CIP) 
field item 


attempts 

sampled 


coded 

correctly 


Percent 

recoded 


vague 
to code 


attempts 

sampled 


coded 

correctly 


Percent 

recoded 


vague 
to code 


Total 


108 


66.7 


23.1 


10.2 


70 


71.4 


18.6 


10.0 


Teaching field 


52 


71.2 


17.3 


11.5 


31 


67.7 


22.6 


9.7 


Research field 


6 


50.0 


33.3 


16.7 


3 


100.0 


0.0 


0.0 


Flighest degree 
field 


50 


64.0 


28.0 


8.0 


36 


72.2 


16.7 


11.1 



SOURCE: U.S. Department of Education, National Center for Education Statistics, 2004 National Study of 
Postsecondary Faculty (NSOPF:04) field test. 



In addition to the 10 percent recode, all strings that were not coded, were partially coded 
(into a general area but not a specific discipline), and were coded “other” were evaluated by the 
expert coder and upcoded into the appropriate CIP categories, where possible. Of the 1,871 
verbatim strings provided, a total of 190 strings (10 percent) qualified for this upcoding; 83 
percent of these were web respondents and 17 percent were CATI respondents. Of these 190 
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strings for which upcoding was attempted, 75 percent were upeoded, 23 percent were too vague 
to code, and 2 percent were correctly coded as “other.” 

4.3.9 IPEDS Coding 

The faeulty instrument included an online coding system that assisted web respondents 
and interviewers in collecting postsecondary institution information. This system was designed 
to improve data quality by allowing respondents to clarify coding choices at the time eoding was 
performed. To assist in the online coding process, web respondents were given detailed 
instructions on screen that enabled them to loeate the postsecondary institution. In addition to 
these on-sereen instructions, interviewers were given additional supervised training on how to 
effectively probe and eode respondents’ answers. 

The institution eoding system was used to assign a six-digit IPEDS identifier for the 
postsecondary institution that awarded the respondent’s highest degree. To facilitate eoding, the 
eoding system requested the state and eity in whieh the sehool was loeated, followed by the 
name of the institution. The system relied on a look-up table of institutions constructed from the 
IPEDS institutional database. 

Of the approximately 1,500 institutions coded over the course of data oolleetion, 53 were 
initially deemed uncodeable. However, based on the information collected (institution name, 
location, level, and control), 43 institutions were positively identified and recoded during the 
data file editing stage of the project. Of the remaining 10 uncodeable institutions, five were 
identified as closed, four provided insuffieient data, and one institution was identified as foreign. 

4.3.10 Monitoring 

Regular monitoring of telephone data colleetion serves a number of goals, all aimed at 
maintaining a high level of data quality. These objectives are to obtain information about the 
interview process that ean be used to improve the design for the full-scale study; to obtain 
information about the overall data quality; to improve interviewer performanee by reinforcing 
good interviewing behavior and discouraging poor behavior; and to detect and prevent deliberate 
breaches of procedure, sueh as data falsification. 

Two types of monitoring were performed during the NSOPE field test data collection. 
The first type was monitoring by project staff, which involved listening to the interview and 
simultaneously viewing the progress of the interview on sereen, using remote monitoring 
telephone and eomputer equipment. Project staff evaluated sueh things as whether the 
interviewer sounded professional, probed for eomplete answers, used the help text to answer 
respondents’ questions, and handled refusal eases appropriately. Interviewers reeeived feedback 
on their skills, and additional training was provided, if necessary. When monitoring interviews, 
project staff also evaluated whether the interview was funetioning properly and identified 
questions in the interview that were difficult to administer so that those items could be revised 
for the full-scale study. 

The second type, quality assurance monitoring, was conducted by speeially trained 
monitoring staff within the call center. Similar to project staff monitoring, the monitoring 
system provided for simultaneous listening and viewing of the interview. Monitors listened to 
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up to 20 questions during an ongoing interview and, for eaeh question, evaluated the interviewer- 
respondent interehange on whether the interviewer (1) delivered the question eorreetly and 
(2) keyed the appropriate response. Monitors reeorded their observations on laptop eomputers, 
whieh eontained computerized monitoring forms. Each of these measures was quantified and 
daily, weekly, and cumulative reports were produced. Monitoring took place throughout data 
collection, although monitoring efforts were scaled back around the 10th week due to lighter 
caseloads. Of the 848 items monitored, only eight delivery errors and two entry errors were 
observed, all within the first 8 weeks of data collection. 

4.3.11 Respondent Feedback 

Respondents were given the opportunity to provide feedback on the last form of the 
faculty instrument (Q84). This open-ended question asked for comments, questions, or concerns 
that would be used to improve data collection procedures for the full-scale study. 

Of the 908 respondents who completed the interview, 380 (42 percent) provided 
comments, which were evaluated and categorized by type of comment. One-quarter of the 
comments concerned instrument issues, including CIP coding (categories too broad, too 
specific), definitions, response options, response metric, or personal/sensitive nature of particular 
questions. Seventeen percent commented that the questionnaire content did not apply to them 
for various reasons (e.g., part-time faculty member, on sabbatical, librarian). Interview length 
and screen load times accounted for 17 percent of responses. Ten percent gave complimentary 
feedback on the survey. Four percent commented about technical difficulties (e.g., computer 
configuration, window sizing). Confidentiality or web security was a concern for 3 percent. A 
miscellaneous category compiled all other comments. 

4.3.12 Interviewer Feedback 
Quality Circle Meetings 

Quality Circle meetings provided opportunities for interviewers, supervisors, and project 
staff to discuss issues pertinent to the NSOPF:04 field test. These meetings were scheduled 
regularly throughout the data collection period to ensure that CATI interviews were being 
conducted in the most effective manner. Interviewer representation was determined by a 
supervisor so that all staff would have the opportunity to attend these meetings. Project staff 
updated interviewers and supervisors on the progress of data collection and gathered information 
to solve problems encountered by interviewers while conducting interviews. As a result of these 
meetings, slight modifications were made to the instrument. The minutes from these meetings 
were prepared by project staff and were distributed to all interviewers and supervisors. Meeting 
minutes were available in hardcopy and online. Examples of issues raised in Quality Circle 
meetings included the following. 

Progress of data collection. Project staff provided updates regarding the interviews 
completed to date and goals for the upcoming week. This information benefited both the 
interviewers and technical staff by recognizing interviewers’ efforts and encouraging continued 
professionalism. 
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CATI Case Management System (CMS) issues. Interviewers identified and reported 
several CMS issues — aeeessibility of help sereens, ease-level eomments not being saved, eases 
spontaneously moving out of the supervisor review queue, and appointment setting — that 
required fixes during data eolleetion. They also requested CMS eustomization for this 
population. Using the information provided, projeet staff resolved these issues during data 
eolleetion. 

Data collection reminders. Several issues were stressed throughout data eolleetion; read 
all response options where applieable, give appropriate feedbaek to sample members, and ask for 
an evening instruetional supervisor at the institution to aid in loeating part-time employees. 
Interviewers were reminded not to eode sample members as ineligible in the front-end sereens, 
instead allowing the interview responses to determine (based on Q1 and Q3) whether the sample 
member was eligible. Interviewers were also reminded to eomplete problem sheets (see later 
seetion in this ehapter) for any oases that needed attention. 

Instrument issues. During the Quality Cirole meetings, projeet staff olarified speoifio 
items in the instrument for the interviewers. These items were brought to the attention of projeet 
staff in problem sheets, projeet staff monitoring, or Quality Cirole meetings. The instrument 
designers asked interviewers to note partioular questions or help text that oould be revised. Other 
instrument disoussions fooused on how to properly eode responses (e.g., for QIO, adjunot faoulty 
should be ooded as “other”; for questions expeoting a numerio response, answers between zero 
and one should be rounded up to one). 

Changes to the instrument. Updates were made to the instrument during data 
eolleetion. An example of an instrument ehange based on an issue raised by interviewers in a 
Quality Cirele meeting was the addition of help text to the items regarding funding of seholarly 
aetivities. The revised help text defined what was meant by “funded” and reeommended baeking 
up to ehange the gate question (Q55) if the answer to the nested item (Q59) indieated the 
respondent did not have funded seholarly aetivities. For questions sueh as the follow-up ineome 
items with eategorieal response options (Q66B and Q70B), interviewer notes (whieh appeared at 
the top of eaeh sereen for CATI interviews only) were ehanged to instruet interviewers to stop 
reading response options onee the sample member had answered the question. These minor 
ehanges enabled the interview to be eondueted more effieiently. 

Coding. The majority of online eoding during data eolleetion was aeeurate, based on 
evaluation of verbatim strings and the eodes assigned (see earlier seetion in this ehapter on CIP 
eoding), although in some eases the verbatim string was too vague to eode. Interviewers were 
reminded to ask the sample member for the neeessary level of detail while entering the verbatim 
string. 



Web issues. A number of web-related issues were raised during Quality Cirele meetings. 
Responding to reports of slow sereen loads, interviewers were asked to time delays between 
sereens (i.e., transit or load time) in order to gather preeise information about web delays. 
Interviewers were reminded to elearly state the study web address (URL) to sample members. 
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Interviewer Debriefing 

A debriefing meeting was held at the end of data colleetion for the field test. The purpose 
of this meeting was to elieit feedback from the interviewers on various aspects of the field test 
data collection process, including training, contacting and locating, and the faculty questionnaire. 
In attendance were telephone interviewers, help desk operators and their supervisors, selected 
project staff, and the study project officer. The field test debriefing session was highly 
informative and gave project staff a wealth of information that will inform instrumentation and 
data collection activities for the full-scale study. 

Training, Interviewers indicated that the training they received, both technical and 
instrument-specific, was sufficient for their needs. Project staff and interviewers agreed that 
more training on the CMS is needed, particularly since inexperienced interviewers will be hired 
for the full-scale study. 

The interviewers stated that the CIP coding was helpful, but they indicated that they 
would have liked additional practice and that they would have benefited from feedback from 
project staff about the accuracy of their coding in the initial days of interviewing. A hands-on 
coding session, similar to those provided in other National Center for Education Statistics 
(NCES) project trainings, is recommended for the full-scale training. 

Contacting and locating. Names and telephone numbers of sample members were 
preloaded into the CMS. Interviewers stated that it would be helpful if home and office 
telephone numbers were differentiated in the CMS. This would allow for more efficient calling 
because the scheduler could select the appropriate telephone number based on the time of day. 

Interviewers reported that it was advantageous to call faculty sample members at home 
on the weekends because they were willing to schedule an appointment to be interviewed at their 
offices. Interviewers also noted that early morning (weekdays) was the most successful time for 
faculty contact. 

Part-time faculty were often difficult to locate (e.g., no office telephone number was 
available or receptionists were not allowed to provide home telephone numbers). Interviewers 
reported that departmental secretaries or evening instructional supervisors were sometimes able 
to provide locating information. 

Some colleges have more than one campus. Eocating the sample member would have 
been more efficient if the sample member’s campus was identified in the preload information. 

The CMS did not have a place to collect an e-mail address for the sample member. This 
has been requested for the full-scale study. 

The need for improved refusal conversion techniques for the full-scale interview was 
discussed. The interviewers believed that the addition of refusal conversion scripts tailored to 
the particular type of refusal would help engage sample members in the survey. Eor example, if 
a respondent had told the previous interviewer he/she was too busy, the script might begin, “I 
understand this is a busy time of the year....” Thorough and accurate comments regarding the 
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reason for refusal would also aid in refusal eonversion. Interviewers suggested that an earlier 
mention of the ineentive for refusal cases might be beneficial. 

Instrument, In preparation for NSOPF:04 full-scale instrumentation activities, project 
staff asked interviewers which items in the instrument were problematic. Interviewers responded 
with general comments as well as item-specific ones, based on their interviewing experience. 

General comments. Interviewers reported that sample members repeatedly indicated that 
parts of the survey (e.g., questions about club assistance, scholarly activities) did not apply to 
them. Typically these respondents were part-time faculty or those with no instructional duties. 

Question 3. Q3 (faculty status) had a high rate of help-text hits for both the web and 
CATI formats. Interviewers explained that some sample members were not sure if they were 
faculty. It was recommended that the wording be changed to ask: “Did [institution name] 
consider you to have faculty status?” 

Question 4. Interviewers pointed out that Q4 asks an open-ended question (“What was 
your principal activity at [institution name] during the 2002 Fall term?”) followed by a 
restatement with response options (“Was your principal activity... teaching, research, public 
service, clinical service, administration, on sabbatical, or some other activity?”). Respondents 
tended to answer before the list was read. Project staff and interviewers redesigned the wording 
to improve the administration of this item. 

Question 10. Interviewers indicated that respondents often provided an answer to QIO 
(academic rank) before the list was read. Project staff emphasized that the list must be read to 
distinguish assistant and associate professors from full professors. 

Question 15. Q15 (reason for not being a member of a union) had a high rate of missing 
data. Interviewers said this was because part-time and adjunct faculty often did not know 
whether unions were available and could not answer using the response options provided. 

Question 17. The IPEDS coding screens (Q17A4, Q17C3, Q17D2) often appeared to 
“hang” when users were trying to search/select the institution, due to the slow computer system 
response times. The slow load-time issue is addressed under Additional issues below. 

Questions 31 through 34. Numerous issues were raised regarding Q31 through Q34 
(allocation of work time on various activities). For Q31D, sample members requested specific 
examples regarding what was included in “unpaid professional service.” Sample members’ ideas 
of paid and unpaid activities often differed from the examples provided in the instrument. 
Interviewers reported that some sample members equated “service” with faith-related activities. 
Project staff recommended changing the wording to “unpaid professional services related to your 
work.” 



Interviewers reported that at Q32 they often had to back up to Q3 1 because sample 
members had not included some of their work-related activities (e.g., did not count their research 
time). 
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Respondents found it difficult to allocate their time, and interviewers reported that this 
series of questions was so wordy that sample members could not comprehend it all. In 
particular, on Q33 and Q34, interviewers reported confusion on the part of sample members in 
making the numbers sum to 100 percent when they said in Q32 that activity accounted for only a 
portion of their time. They recommended asking Q33 immediately after Q32A, and Q34 
immediately after Q32C rather than on a new screen. 

Question 35. Sample members often were unclear what was meant by the term 
“developmental” in Q35B, and “distance education” in Q35C. More information, either in the 
help text or in the question, is recommended for the full-scale study. 

Question 37. Interviewers requested that the tab function for Q37 (matrix to collect 
information about each class taught) be changed to move from top to bottom (to match the order 
in which the questions are asked) rather than left to right. 

Question 38. Interviewers reported several problems with Q38 (student evaluation). The 
first item, “student evaluations of each other’s work,” was confusing to respondents. There was 
also uncertainty over whether the question was asking if these tools were ever used or if they 
were exclusively used. Interviewers noted that the current wording/response options (“used in 
all classes, some classes, or no classes”) do not work well if the sample member teaches only one 
class. The instrument designers indicated the items will be rearranged and the terminology made 
clearer in the full-scale instrument. 

Questions 44 and 45. Several issues were reported concerning the training/professional 
development questions (Q44 and Q45). Respondents did not understand what was being asked 
in Q44, and coming up with a total of hours for the calendar year in Q45 was difficult for many 
respondents. Interviewers stated that some faculty members were disappointed that the survey 
did not have any follow-up questions about the effectiveness of training asked about in Q44 and 
Q45. 



Question 47. For Q47 (individual instruction), it would be helpful to add the phrase “for 
credit.” Based upon earlier responses in the questionnaire about level of students (Q33, Q37), 
skip logic could be added so that the interview would route to undergraduate, graduate, or first- 
professional questions. Sample members were often unclear what was meant by the terms 
“individual instruction,” “first-professional,” and “contact hours” in Q47 and Q47B. More 
information, either in the help text or in the question, is recommended for the full-scale study. 

Question 50. Advising of students (Q50) was a difficult concept for some sample 
members. Alternative wording (“Were you an advisor? How many students did you advise?”) 
was suggested to clarify the meaning. 

Question 52. In Q52A (number of scholarly works), sample members expressed 
confusion over whether “career” meant their career as a teacher or their entire lifetime of work. 
Interviewers recommended adding the word “entire” (i.e., “During your entire career...”) to 
provide clarification on the timeframe. Interviewers suggested combining Q52A and Q52B (i.e., 
“and how many of those were in the past 2 years?”) to reduce the interview length and improve 
the flow. 
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Question 59. A recurring problem was that sample members indicated their scholarly 
activities were funded (Q55), but when asked the number of grants/contracts (Q59), they 
responded with zero (which was not allowed by the instrument). Interviewers suggested 
positioning question Q59 immediately following Q55 to facilitate backing up to correct the gate 
question. Alternatively, question wording may be changed to clarify what is meant by funded 
activities. 

Questions 61 and 62. The response options for Q61 and Q62 (job satisfaction) should be 
altered to allow “satisfied” as an acceptable response rather than requiring the respondent to 
choose between very and somewhat satisfied. Interviewers requested changing the order of the 
response options on screen so that “satisfied” is on the left and “dissatisfied” is on the right. In 
addition, interviewers pointed out that the question wording for Q62 was redundant with Q6I 
(because Q6I was skipped for sample members without instructional duties). Q62C (satisfaction 
with benefits) was not answered by many respondents (mostly part-timers) because it did not 
apply to them. It would be good to know if this group is dissatisfied with the benefit or 
dissatisfied because of not being offered the benefit. 

Questions 62 through 65. The order of questions Q63, Q64, and Q65 (retirement) should 
be changed to ask the two questions about age at retirement (Q63 and Q65) consecutively. 

Question 66. Sample members complained that Q66 (income) was intrusive. 

Interviewers suggested that Q66C, Q66D, Q66E, and Q66F be combined into a single question 
about “other” (i.e., not from target institution) income. Interviewers thought this would help 
reduce refusals for these questions. Another suggestion was to place Q70 (household income) 
adjacent to Q66 and change the wording (“Do you have additional household income?”) to aid in 
resolution between the two amounts. 

Question 84. Interviewers requested that Q84 (comments) remain in the full-scale 
interview to allow sample members the opportunity to express concerns or provide other 
information they deem important. They felt they could use this as an incentive to get the sample 
member to complete the interview. 

Additional issues. The help desk staff stated that many sample members were unwilling 
to change the settings on their computers (i.e., cookies, Java) in order to complete the survey on 
the web. 

The length of the interview, particularly slow page load times, was problematic. 
Interviewers indicated that web delays disrupted the flow of the interview; they expressed 
concern that inexperienced interviewers in the full-scale study, faced with slow system response, 
would not be adept at filling the void. Interviewers requested putting more than one question on 
a page to reduce the number of page loads; they foresaw no problems with scrolling down the 
screen to access questions. Project staff stated that the U.S. Department of Education is working 
to increase the bandwidth on its server, which should speed the screen transition time of web- 
based surveys. 
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Problem Sheets 

When interviewers encountered problems during an interview, a description of the issue 
was documented in the form of an electronic problem sheet. Project and interviewer supervisory 
staff regularly reviewed these problem sheets and worked on resolving these problems, as 
appropriate. Approximately 250 problem sheets were submitted during the faculty field test data 
collection period. 

Problem sheets were used as follows: 

• To address technical CMS issues. Interviewers documented details of the front-end 
issues so that a programmer could resolve them. 

• To report system and web delays. 

• To document sample member contact information as a workaround for front-end 
issues. 

• To alert project staff to questions about sample member eligibility, contact 
information, and refusals. 

• To record incorrect data that were entered (but not corrected) for a case. Interviewers 
noted cases where project staff needed to take specific action. Project and interviewer 
supervisory staff ensured that issues pertinent to data collection were resolved as soon 
as possible. 

4.4 Data File Preparation 

The following files were produced from the NSOPF:04 field test data: 

• Institution data file. Contains institution interview data collected from 114 
institutions. Topics include numbers of part-time and full-time faculty and 
instructional staff, tenure, employee benefits, and personnel evaluation. 

• Faculty data file. Contains interview data collected from 914 faculty and 
instructional staff. Topics include employment, academic background, workload, 
scholarly activities, job satisfaction, compensation, sociodemographic characteristics, 
and opinions. 

In addition to the coding described earlier in this chapter, the NSOPF:04 field test data 
were edited using procedures developed and implemented for previous NCES-sponsored studies. 
These procedures were tested again during the field test in preparation for the full-scale study. 

During and following data collection, the institution and faculty data were reviewed to 
confirm that the data collected reflected the intended skip-pattern relationships. At the 
conclusion of data collection, special codes were inserted into the database to reflect the different 
types of missing data. A variety of explanations are possible for missing data. For example, an 
item may not have been applicable to certain respondents or a respondent may not have known 
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the answer to the question. Table 4.18 lists the set of consistency codes used to assist analysts in 
understanding the nature of missing data associated with NSOPF data elements. 

Table 4.18 Description of missing data codes: 2003 

Missing data code Description 

-1 Don’t know 

-3 Not applicable (item was intentionally skipped) 

-5 Not applicable (item was asked but respondent indicated it was not applicable) 

-7 Item was not reached (partial interview) 

-8 Item was not reached due to a programming error^ 

-9 Data missing, reason unknown 

'a programming error related to form Q37 for the subset of respondents who taught more than eight classes during 
the 2002 Fall term (Q35A1>8) was discovered during data collection and corrected. The error prevented the Q37 
data from being recorded for five cases. 

SOURCE: U.S. Department of Education, National Center for Education Statistics, 2004 National Study of 
Postsecondary Faculty (NSOPF:04) field test. 

Skip pattern relationships in the database were examined by systematically running cross- 
tabulations between gate items and their associated nested items. In some instances, gate-nest 
relationships had multiple levels within the instrument. That is, items nested within a gate 
question were themselves gate items for additional items. Therefore, validating the gate-nest 
relationships often required multiway cross-tabulations to ensure the proper data were captured. 

The data cleaning and editing process for the NSOPF:04 field test data files consisted of 
the following steps: 

Step 1. Review of one-way frequencies for every variable to confirm no missing or blank values 
and to check for reasonableness of values. This involved replacing blank or missing 
data with -9 for all variables in the instrument databases and examining frequencies for 
reasonableness of data values. 

Step 2. Review of two-way cross-tabulations between each gate-nest combination of variables 
to check data consistency. Legitimate skips were identified using the interview 
programming code as specifications to define all gate-nest relationships and replace -9 
(missing values that were blank because of legitimate skips) with -3 (legitimate skip 
code). Additional checks ensured that the legitimate skip code was not overwriting 
valid data and that no skip logic was missed. In addition, if a gate variable was missing 
(-9) then the -9 was carried through the nested items. 

Step 3. Identify and code items that were not administered due to a partial faculty interview. 
This code replaced -9 and -3 values with -7 (item not administered) based on the 
section completion indicators. The -7 code allowed analysts to easily distinguish items 
not administered from items that were either skipped or simply left blank. 

Step 4. Identify items requiring recoding. During this stage, previously uncodeable values 
(e.g., text strings) collected in the various coding systems were upcoded, if possible 
(see earlier sections in this chapter on other specify coding, CIP coding, and IPEDS 
coding). Typically, logical imputations are implemented at this stage to assign values 
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to missing items whose values could be implicitly determined (i.e., the item was 
appropriately skipped). This was not done in the field test due to time constraints. 

Step 5. Final check of data. One-way and two-way frequencies on all variables were 
regenerated and examined. 

Concurrent with the data cleaning process, detailed documentation was developed to 
describe question text, response options, recoding, and the “applies to” text for each delivered 
variable. 

4.5 Conclusion 

The goal of this chapter was to evaluate the quality of the data collected in the NSOPF:04 field 
test. The major findings of these evaluations are as follows: 

• With regard to list quality, IPEDS counts were often smaller than those obtained from 
the institutional questionnaire or tallied faculty lists, due to definitional differences. 
This shortage was more pronounced for part-time faculty. 

• Institution questionnaire and tallied faculty list counts were relatively more consistent 
with each other, with 89 percent being within + or - 25 percent of each other for full- 
time faculty and 86 percent for part-time faculty. 

• Item nonresponse was below 10 percent for all but 2 of the 83 items in the institution 
questionnaire and for all but 1 1 out of the 250 items in the faculty questionnaire. 

• Web respondents to the faculty survey were significantly more likely to use the 
“don’t know” response option (available for 6 items in the instrument) than were 
CATI respondents. This was not unexpected, given that the “don’t know” option was 
visible to web respondents whereas CATI respondents were not read that option. 

• The temporal stability of a subset of faculty items was evaluated using a reinterview. 
Of the 26 items evaluated, 15 had percent agreement over 90 percent, 6 had percent 
agreement between 80 and 90 percent, and 5 had percent agreement less than 80 
percent. There were no statistically significant modal differences in percent 
agreement for any of these items. 

• Resolution screens were effective in reducing the amount of inconsistent data 
collected in the faculty instrument. 

• Nine of the 113 forms (screens) in the faculty instrument had help text access rates 
greater than 10 percent, suggesting that there were problems with the wording or lack 
of information provided. 

• Four screens with “other, specify” verbatim strings were evaluated and additional 
response options were proposed for addition to the full-scale instrument. 
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• A 10 percent recoding of CIP verbatim strings (during the data file editing stage of 
the project) showed that 69 percent were coded correctly, 21 percent were incorrectly 
coded, and 10 percent of the strings were too vague to determine whether they were 
correctly coded. There were no significant modal differences in the coding results. 

• Fifty-three of the approximately 1,500 institutions coded during data collection were 
initially deemed uncodeable. Based on the school information collected, 43 of these 
were positively identified and recoded during the data file editing stage of the project. 

In addition to these evaluations of data, respondent feedback (an open-ended question at 
the end of both the institution and faculty questionnaires), interviewer feedback (problem sheets, 
quality circle meetings, and an interviewer debriefing) and project staff monitoring provided 
information that will inform the full-scale instrumentation. Plans for the full-scale study, and the 
institution and faculty instruments in particular, are the focus of chapter 5. 



95 



NSOPF:04 Field Test Methodology Report 






Chapter 4. Evaluation of Data Quality 



This page left intentionally blank. 



NSOPF:04 Field Test Methodology Report 



96 






Chapter 5 

Plans for the Full-Scale Study 



The primary goal of the National Study of Postseeondary Faculty (NSOPF;04) field test 
was to test procedures and inform planning for the full-scale study. Overall, the essential aspects 
of the field test study — including sampling design, list collection, instrumentation, institution and 
faculty data collection, and data editing — were successfully conducted, as documented in 
chapters 3 and 4. Planned changes, based on the field test experience, are summarized below. 

5.1 Incentives 

The results of the field test incentive experiment supported the hypotheses that offering 
incentives would significantly increase the response rate during the first phase of data collection 
and increase the completion rate during the computer-assisted telephone interviewing (CATI) 
nonresponse follow-up phase of data collection. Based on these findings, it is planned that 
incentives will be offered to all sample members during the web early-response period and again 
during the CATI nonresponse period for the full-scale study. Because there was no significant 
difference in response rates for those who were offered $20 versus $30 during the early incentive 
phase, the use of a $20 incentive to encourage early response is planned for the full-scale study. 
The use of a $30 incentive is planned for nonresponse conversion.^^ 

5.2 Instrumentation 

Based on analyses of the NSOPF:04 field test data for the institution and 
faculty/instructional staff questionnaires, interviewer debriefings, monitoring of interviews, 
examination of the open-ended comments provided by the respondents, and comments and 
rankings of the NSOPF Technical Review Panel, several pertinent recommendations emerged for 
the NSOPF;04 full-scale study. These actions should improve the quality of the data collected 
with the instruments, improve the efficiency of the electronic data collection, and (importantly 
for the faculty/instructional staff questionnaire) reduce the overall time to complete the 
instruments.^^ 

Institution. While the average time to complete the NSOPF:04 field test institution 
questionnaire was 27 minutes, considerably less than the goal of 50 minutes for the study, it is 
likely that processing efficiency can be increased nonetheless for the full-scale study. The 
instrumentation design for the full-scale study will incorporate these efficiency-gaining steps, 
including reducing database table sizes, reducing the volume of text transported between 

This was our request to the Office of Management and Budget, however, the final decision was to offer a $30 
incentive for both early response and nonresponse to make them equitable. See the methodology report for the full- 
scale study for detailed information on incentives used in the full-scale study. 

In addition to these planned changes, the Department of Education doubled its Internet connection bandwidth 
shortly after the end of the NSOPF:04 field test. This step is likely to improve data collection performance for the full- 
scale study. 
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respondents’ eomputers and the instrument server for eaeh instrument sereen, and redueing the 
information stored in eaeh data table (e.g., 8-byte vs. 1-byte variables for yes/no responses). 

In addition, several institution items eould benefit from revision for the full-seale study. 
We plan to update instrument forms, help sereens, and informed consent for the full-scale study 
(e.g., change target time period to “2003 Fall term”). Based on field test monitoring and timing 
analysis, we concluded that help screens were unnecessary and will be removed from the full- 
scale instrument. Changes planned for the institution questionnaire appear in table 5.1. 

Table 5.1 Changes to institution questionnaire items planned for the full-scale study: 2003 

Item Planned change 

1A-1B Change data collection “flow” for the instrument. Allow respondents to temporarily skip 
items 1A- IB (numbers of full-time and part-time faculty and instructional staff at target 
institution) and complete later instrument items. 

2 Revise wording for response option C (number of new hires). 

10A-10B Add medical, dental, disability, and life insurance items to the stem wording to make this 

question on employment benefits comparable to 15A; expand response options from yes/no 
to all/some/none. 

1 1 Expand response options from yes/no to all/some/none. 

15A-15B Expand response options from yes/no to all/some/none. 

19 Revise name of section heading (Assignment of Undergraduate Instruction) and item stem B 

(including adjuncts). 

SOURCE: U.S. Department of Education, National Center for Education Statistics, 2004 National Study of 
Postsecondary Faculty (NSOPF:04) field test. 

Faculty. In order to achieve the instrumentation goal for a 30-minute self- administered 
web questionnaire or CATI interview with faculty and instructional staff, the time to complete 
the instrument, as demonstrated during the NSOPF:04 field test, must decrease by 12 minutes. 
Procedures and approaches planned for the full-scale study that are expected to reduce the time 
to complete the instrument include the following: 

• Eliminate field test instrument items from the full-scale study faculty/instructional 
staff instrument to shorten the time to complete. Table 5.2 describes the planned 
deletions. Our priorities for selecting items were based on each item’s policy 
relevance, historical use in congressionally mandated or other National Center for 
Education Statistics analytical reports, rankings of the Technical Review Panel 
concerning the item, and population size upon which the instrument item can be 
generalized. Based on the field test per item timing analyses, these deletions will 
shorten the interview by approximately 7 minutes. 

• Implement efficiency-gaining activities, as noted above for the institution 
questionnaire, to improve information transmission and data reading/writing 
performance for the instrument. In addition, the increase in U.S. Department of 
Education bandwidth (implemented at the end of the field test) is expected to reduce 
transmission times in the full-scale study. 
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Table 5.2 Faculty and instructional staff questionnaire items planned for deletion and amount of 
time saved from the full-scale study: 2003 



Item 


Label 


Time saved 
(seconds) 


Total 




449.0 


Q7 


Part-time faculty: years employed part time 


9.8 


Q17B 


Holds Ph.D. in addition to professional degree 


0.3 


Q17C 


Year received doctoral degree 


0.0 


Q17C2VS 


Doctoral field — verbatim 


0.0 


Q17C2CD 


Online coding: doctoral field 


0.0 


Q17C3 


Online coding: doctoral degree institution (name, city, state) 


0.2 


Q17D2 


Online coding: bachelor’s degree institution (name, city, state) 


38.5 


Q19C 


Number classes taught full time/part time at other postsecondary institution 


3.9 


Q20 


Non-postsecondary education jobs related to teaching field 


6.1 


Q22 


Total number of postsecondary educators employed as faculty 


13.3 


Q25 


First postsecondary faculty position — academic rank 


6.9 


Q29 


Previous job related to teaching field 


10.7 


Q30 


Years teaching in postsecondary institutions 


9.1 


Q34A-Q34D 


Percentage allotment of other time 


76.4 


Q40A-Q40G 


Uses of website 


24.6 


Q43A-Q43D 


Plan/develop instruction/curriculum/employment opportunities 


51.9 


Q44A-Q44F 


Training opportunities 


56.0 


Q45 


Hours professional training in 2003 


27.1 


Q52AICAT 


Categorical items for nonresponse follow-up to Q52AA-Q52AG 


6.3 


Q58 


Primary funding source 


6.9 


Q59 


Number of grants/contracts 


7.8 


Q60A 


Total funding grants/contracts 


3.5 


Q60B 


Range total funding grants/contracts 


0.7 


Q63 


Age expecting to stop working at postsecondary institution 


20.3 


Q76A-Q76E 


Type of disability 


0.9 


Q78 


Number of dependents 


14.1 


Q84 


Respondent comments and suggestions 


53.7 



NOTE: Plans for item deletion were developed based on examination of timing reports, use of the item in previous 
reports, monitoring of interviews, reliability testing, and rankings of the item by project staff and Technical Review 
Panel members. Estimates of time saved are based on the total time spent on a given form (on-screen plus transit 
time) summed across all cases that reached the form in the field test, divided by the number of completed surveys 
(n=914). 

SOURCE: U.S. Department of Education, National Center for Education Statistics, 2004 National Study of 
Postsecondary Faculty (NSOPF:04) field test. 

• Develop and implement an online autoeoding routine for the aeademie diseiplines or 
fields eolleeted during the interview. (During the field test, Classifieation of 
Instructional Program [CIP] codes were identified using drop-down boxes for each 
sample member’s fields of teaching, scholarly activity, and highest degree. The field 
of teaching coding took 42 seconds, on average [49 seconds for self-administered 
respondents and 36 seconds for CATI respondents].) The autoeoding utility will 
match respondent-provided verbatim strings for teaching (Q16VS), highest degree 
(Q17A3VS), and research (Q54VS) to a data table of CIP codes, and will ask 
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respondents for eonfirmation. (The eurrent online eoding system will be used for all 
diseipline strings that do not autoeode suceessfully.) 

• Revise and more elosely target the online help text for all instrument screens to 
ensure that the help provided to respondents is necessary and sufficient for this 
purpose. This will involve moving some of the help text to the questionnaire screens 
and eliminating unneeded help text for several items. 

• Improve item wording, in particular screen fills to shorten item wording, and combine 
screens to reduce the numbers of data transmissions. 

While it is impossible to accurately estimate the impact of these actions, they are 
projected to yield a 30 minute interview. 

5.3 Institution Contacting and Data Collection 

Early contacting. Timely submission of faculty lists has been a chronic problem on past 
iterations of NSOPF. Many institutions lack the resources to participate in nonmandatory 
studies, and other institutions put survey requests through lengthy internal review processes 
(institutional review boards [IRBs], faculty senate discussion, etc.). Although the total effect of 
combining data collection for NSOPF with the National Postsecondary Student Aid Study 
(NPSAS) under the National Study of Faculty and Students (NSoFaS) is unclear at this time, it is 
unlikely to alleviate these problems, which continue to negatively impact the data collection 
schedule. To ensure completion of the full-scale NSOPF and NPSAS studies in the abbreviated 
timeframe available, early contacting of institutions is planned to facilitate identification and 
resolution of problems (e.g., IRB and faculty senate requirements) prior to data collection. 

Web forms and instruments. One of the changes made for the NSOPF:04 field test was 
to eliminate the paper version of the institution questionnaire, the “Designation of Coordinator” 
form, and other documentation. The overwhelming majority of respondents were, indeed, able 
to complete the institution questionnaire online, with only a handful completing the instrument 
over the phone or faxing it. While the “Designation of Coordinator” form was often completed 
by phone, this was also true in past NSOPF iterations, and the absence of a paper form did not 
lead to complaints from institutions. The availability of these forms on the website helped 
eliminate the delays caused by remailing. Because this elimination of paper forms in the field 
test was successful, the same methods are planned for the full-scale study. 

Institution questionnaire data collection. Although the institution questionnaire is 
designed to be self-administered, in each cycle of NSOPF, a significant number of institution 
questionnaires have been completed through direct “interviewer assistance.” In such a case, the 
interviewer calls various offices and individuals at the institution to collect the data, often 
completing the questionnaire in installments. Due to the schedule constraints of the full-scale 
study, we plan to begin making these calls immediately after the deadline for completing the 
institution questionnaire has passed. Moreover, it may be possible to contact respondents for 
additional information by more efficient electronic means, using e-mail addresses provided by 
sample respondents for the instrument’s contact information item (20). 
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Twelve-state participation/collecting data at a system-wide level. Lead 
representatives from the 12 states partieipating in the NPSAS oversample proved partieularly 
helpful in two states — Georgia and New York — where system-level assistance was offered to 
institutions that otherwise would have refused participation. Indeed, without this assistance, a 
majority of institutions in both states would have refused. For the full-scale study, some states 
already have indicated they could provide all data for both NSOPF and NPSAS at a system-wide 
level. Given the fruitfulness of these arrangements during the field test, these arrangements will 
be explored and developed for the full-scale study. 

5.4 Faculty Data Collection 

Training, For the field test, NSOPF used only experienced CATl interviewers. The size 
of the full-scale sample likely will require a mixture of experienced and new interviewers. 
Recognizing the different needs of new interviewers, the focus of training will change somewhat. 
That is, more time will be spent on modules that are more difficult for new interviewers, such as 
locating and contacting sample members and coding programs. 

Contacting, The use of letters and e-mails to contact sample members will continue in 
the full-scale study. In addition to the contacting materials described in chapter 2, two additional 
e-mail reminders could be sent during the early incentive period. The first of these would be sent 
approximately halfway through the early-response incentive period and the other would be sent 
about 3 days before the end of the early-response incentive period. Letters and e-mails would be 
modified to extend the offer of the incentive to all sample members. 

Tracing, Recognizing the short timeframe for full-scale data collection, speedy locating 
of sample members is crucial in achieving the required response rate. To this end, an immediate 
review of contact data from the faculty lists is planned as they come in, sending all sampled 
cases for which only a school address is available to the tracing staff. Tracing specialists may 
then contact the institution to request additional contact information for the sample member. In 
addition, any cases of missing critical contacting information (such as telephone number) should 
be referred for tracing early in the data collection period. A review of e-mail addresses on the 
sample file provided by the institution is planned, with follow-up of any e-mail addresses that 
appear to be incomplete or incorrect for the school. 

Identifying duplicate office telephone numbers (e.g., a department phone number) for an 
institution — and making a single call to request telephone numbers or other contact information 
for those sample members — ^would make tracing more efficient. In addition, interviewers for the 
full-scale study can collect updated e-mail addresses for those sample members, as well as office 
hours. This information will be used by telephone interviewers to more efficiently reach sample 
members at times when they are scheduled to be in their office, or via e-mail. 

Data collection schedule. A 4-week early-response incentive period (rather than the 
3-week period used in the field test) is proposed for the full-scale study. Allowing an extra week 
for the early-response period is expected to increase the response rate while decreasing CATl 
costs. 
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Data collection systems. Minor revisions to the CATI-Case Management System 
(CMS) are planned for the full-seale study to better serve the NSOPF population. In partieular, a 
plaee to enter and store sample member e-mail address and offiee hours is needed, as is an 
indieator to distinguish between offiee and home telephone numbers to target the appropriate 
number to eall at any given time of day. Ongoing work eontinues to improve the effieieney and 
performanee of this system. 

5.5 Other Issues 

In addition, development of data proeessing/edits, imputation plans, diselosure avoidanee 
plans, and weighting and standard error plans will eontinue, as will the setting up of proeedures 
for ereation of the Eleetronie Codebook and Data Analysis System ahead of time so that the final 
data files and reports ean be prepared quiekly onee data eolleetion ends. The outline and tables 
for the first set of published results eould be established during data eolleetion, so that this 
publieation also eould be prepared very quiekly following the end of data eolleetion. 

5.6 Conclusion 

In eonelusion, the plans for the full-seale NSOPF are as follows: 

• The proeedures used in the NSOPF field test worked well and will be used, with 
modifieation as needed, for the full-seale study. 

• The sampling design and proeedures for the field test were sueeessful and will be 
implemented in the full-seale study. 

• The results of the ineentive experiment have led to the plan to offer ineentives to all 
faeulty sample members in the full-seale study in an effort to reaeh response rate 
goals. 

• The institution and faeulty websites were well-reeeived, requiring only minor 
modifieations for the full-seale implementation. 

• The institution instrument requires very minimal revision. 

• The web-based faeulty instrument was effeetive for self-administration and as a 
telephone interview. Modifieations to shorten it to a 30-minute interview, as well as 
minor ehanges to question wording in response to suggestions from the Teehnieal 
Review Panel (see appendix G), will be implemented for the full-seale study. 

• Minor adjustments to the CATI-CMS front-end system are expeeted to improve the 
doeumentation of eontaet information. 

• More effieient traeing proeedures are planned for the full-seale study, along with 
more foeused training of telephone interviewers to address the various levels of 
experienee. 
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U.S. Department of Education, NCES 

1990 K Street, NW 

Suite 900 

Washington, DC 20006 

Telephone: (202)502-7358 
FAX: (202)502-7490 

Email: lisa.hudson@ed.gov 



Tracy Hunt- White 

Education Statistician 

U.S. Department of Education, NCES 

1990 K St, NW 

Suite 800, Room 8125 

Washington, DC 20006 

Telephone: (202)502-7438 
FAX: 

Email: tracy.hunt-white@ed.gov 



Paula Knepper 

Senior Technical Advisor, PSD 
U.S. Department of Education, NCES 
1990 K Street NW 
Room 8096 

Washington, DC 20006-5652 
Telephone: (202)502-7367 
FAX: (202)502-7372 

Email: paula.knepper@ed.gov 

Roslyn Korb 
Program Director 

Postsecondary Coop System Analysis & 
Dissemination - PSD 
U.S. Department of Education, NCES 
1990 K Street, NW 
Room 8132 

Washington, DC 20006-5652 
Telephone: (202)502-7378 
FAX: (202)219-1529 

Email: roslyn.korb@ed.gov 



Edith McArthur 

U.S. Department of Education, NCES 
1990 K Street, NW 
Room 9081 

Washington, DC 20006-5652 
Telephone: (202)502-7393 
FAX: (202)502-7490 

Email: edith.mcarthur@ed.gov 
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National Study of Postsecondary Faculty (NSOPF:04) 
Staff Contact List — Continued 



Linda Zimbler 

Project Officer, NSOPF:04 

U.S. Department of Education, NCES 

1990 K Street NW 

Room 8123 

Washington, DC 20006-5652 
Telephone: (202)502-7481 
FAX: 

Email: linda.zimbler@ed.gov 



MPR Associates 

Ellen Bradbum 

Principal Investigator, NSOPF:04 
MPR Associates 

2150 Shattuck Avenue, Suite 800 
Berkeley, CA 94704-0794 
Telephone: (510)849-4942 
FAX: (510)849-0794 

Email: ebradburn@mprinc.com 

Susan Choy 
Vice President 
MPR Associates, Inc. 

2150 Shattuck Ave., Suite 800 
Berkeley, CA 94704-1321 
Telephone: (510)849-4942 
FAX: (510)849-0794 

Email: schoy@mprinc.com 

Gary Hoachlander 
President 
MPR Associates 

2150 Shattuck Avenue, Suite 800 
Berkeley, CA 94704-1321 
Telephone: (510)849-4942 
FAX: (510)849-0794 

Email: ghoachlander@mprinc.com 



Pinkerton Computer Consultants, Inc. 

Samuel Bedinger 
Senior Research Analyst 
Pinkerton Computer Consultants, Inc. 
1900 North Beauregard Street 
Suite 112 

Alexandria, VA 22311-1722 
Telephone: (703)845-3134 
FAX: (703)820-7465 

Email: sam.bedinger@pcci.com 

Daniel Fleffron 
Statistician 

Pinkerton Computer Consultants, Inc. 
1900 North Beauregard Street 
Suite 1 12 

Alexandria, VA 22311-1722 
Telephone: (703)845-3139 
FAX: (703)820-7465 

Email: heffrond@pcci.com 

RTI International 

Janet Austin 
TRP Coordinator 
RTI International 
P.O. Box 12194 
RTP,NC 27709 

Telephone: (919)541-7101 
FAX: (919)541-7014 

Email: jra@rti.org 



Margaret Cahalan 
Project Director, NSOPF:04 
RTI International 
1615 M Street NW 
Suite 740 

Washington, DC 20036-3209 
Telephone: (202)728-1967 
FAX: (202)728-2095 

Email: cahalan@rti.org 
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National Study of Postsecondary Faculty (NSOPF:04) 
Staff Contact List — Continued 



James Chromy 

Senior Statistical Advisor, NSoFaS 
RTI International 
PO Box 12194 
RTP,NC 27709 

Telephone: (919)541-7019 
FAX: (919)541-6416 

Email: jrc@rti.org 



T.R. Curtin 

Instrumentation Task Leader, NSOPF:04 
RTI International 
PO Box 12194 
RTP,NC 27709 

Telephone: (919)541-6538 
FAX: (919)541-7014 

Email: trc@rti.org 



Mansour Fahimi 

Statistical Task Leader, NSOPF:04 
RTI International 
1615 M Street NW 
Suite 740 

Washington, DC 20036 

Telephone: (202)728-1969 
FAX: 

Email: fahimi@rti.org 



Ruth Heuer 

Methodology Report Task Leader, NSOPF:04 
RTI International 
PO Box 12194 
RTP,NC 27709 

Telephone: (919)541-6457 
FAX: (919)541-7014 

Email: heuer@rti.org 



Donna Jewell 

Deputy Project Director, NSOPF:04 
RTI International 
PO Box 12194 
RTP,NC 27709 

Telephone: (919)541-7266 
FAX: (919)541-6178 

Email: dmj@rti.org 

Brian Ruhr 

Institutional Coordinator: NSoFaS 

RTI International 

203 North Wabash Avenue 

Suite 1900 

Chicago, IE 60601 

Telephone: (312)456-5263 
FAX: (312)456-5250 

Email: bdk@rti.org 

John Riccobono 

Director, Education Surveys Division 
RTI International 
P.OBox 12194 
RTP,NC 27709 

Telephone: (919)541-7006 
FAX: (919)541-7014 

Email: jar@rti.org 



Roy Whitmore 
Senior Research Statistician 
RTI International 
PO Box 12194 
RTP,NC 27709 

Telephone: (919)541-5809 
FAX: (919)541-5966 

Email rww@rti.org 



114 



NSOPF:04 Field Test Methodology Report 








Appendix B 

Facsimile Instruments 

Institution 117 

Faculty 129 



115 



NSOPF:04 Field Test Methodology Report 






Appendix B. Facsimile Instruments 



This page left intentionally blank. 



NSOPF:04 Field Test Methodology Report 



116 






Appendix B. Facsimile Instruments 




117 



NSOPF:04 Field Test Methodology Report 






Appendix B. Facsimile Instruments 



This page left intentionally blank. 



NSOPF:04 Field Test Methodology Report 



118 






Appendix B. Facsimile Instruments 



2004 National Study of Postsecondary Faculty 
Institution Questionnaire — FACSIMILE 



To Complete the Institution Questionnaire: 

By Web: 

To complete the Institution Questionnaire on the Internet, please connect to the 
NSoFaS:04 Web Site at: httos://survevs.nces.ed.oov/nsofas/ . 



Select: 


Login (Menu item on the left side of Web Site) 


Enter: 


IPEDS UNITID & Password * 


Select: 


Institution Questionnaire 


*(Secure login is printed on the second page of letter from NCES Deputy Commissioner Gary Phillips.) 



By Telephone: 

To complete the Institution Questionnaire, please call 1-866-676-NSOFAS4 (1-866- 
676-3274). You will be able to immediately complete the interview or to schedule an 
appointment for the interview at a convenient time. 
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0MB Clearance No. 1850-0665 
Expiration Date: 08/31/2005 



U.S. Department of Education 
Office of Educationai Research and improvement 



Nationai Center for Education Statistics 



2004 National Study of 
Postsecondary Faculty [Field Test] 

INSTITUTION QUESTIONNAIRE FACSIMILE 

Note: This questionnaire wiii be administered by a seif-administered Web instrument or by 
a computer-assisted teiephone interview. A PDF fiie of the questionnaire wiii be avaiiabie 
during data coiiection at https://survevs.nces.ed.qov/nsofas/ . 



All Information that would permit Identification of individuals will be kept confidential. 



Sponsored by: 

National Center for Education Statistics 
U.S. Department of Education 
1990 K Street, NW 
Washington, DC 20006 

Conducted by: 

RTI International 

PO Box 12194 (3040 Cornwallis Road) 

Research Triangle Park, NC 27709-2914 

For Information, Contact: 

Brian Kuhr 

E-mail: nsofas@rti.org 

Telephone: 1-866-676-3274 (toll free) (1-866-NSOFAS4) 
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Instructions 



The NSOPF:04 folder includes: 1) An instruction sheet for accessing the survey Web Site to complete the 
institution questionnaire and 2) a request for a list of faculty and instructional staff employed in your institution. 
For information about the faculty lists, see Guidance for Preparing List of Faculty and Instructional Staff in the 
folder. 

This survey seeks information about full-time and part-time faculty and instructional staff employed at your 
institution as of November 1 , 2002. 

Full-time and part-time faculty and Instructional staff INCLUDE : 

• All part-time, full-time, temporary, permanent, adjunct, visiting, acting, postdoctoral appointees, tenured, 
tenure-track, non-tenure-track, undergraduate, graduate, and professional school (e.g., medical, law, 
dentistry, etc.) faculty and instructional staff who were on the payroll of your institution as of November 1, 
2002. Include faculty on paid sabbatical leave. 

• Any administrators, researchers, librarians, coaches, etc., who had faculty status at your institution — 
whether or not they have instructional responsibilities — and were on the payroll of your institution as of 
November 1 , 2002. 

• Any administrators, researchers, librarians, coaches, etc., who did not have faculty status at your institution 
but had instructional responsibilities and were on the payroll of your institution as of November 1 , 2002. All 
employees with instructional responsibilities — teaching one or more courses, whether for credit or not for 
credit, or advising or supervising students’ academic activities (e.g., serving on undergraduate or graduate 
thesis or dissertation committees, supervising an independent study or one-on-one instruction, etc.) — during 
the 2002 Fall Term who were on the payroll of your institution as of November 1, 2002 and who may or may 
not have had faculty status. 

Full-time and part-time faculty and Instructional staff DO NOT INCLUDE : 

• Any graduate or undergraduate teaching or research assistants, 

• Faculty and instructional personnel on leave without pay or teaching outside the United States, and 

• Military personnel who teach only ROTC courses, instructional personnel supplied by independent 
contractors, and voluntary medical staff. 

We realize that postsecondary education institutions vary widely in their organizational structures and staffing 
patterns and institutions may use different definitions of faculty and non-faculty positions, temporary and 
permanent status, and full-time and part-time status. Please interpret the instructions and terms according to 
your institution’s usage. 

Respondents. Several people at your institution may complete different parts of the survey. We will ask each 
respondent to provide his or her name and contact information in case we need to recontact someone about an 
answer. Section D on page 7 provides an example of the information we will collect. All information that would 
permit identification of individuals, including names, telephone numbers, and e-mail addresses, will be removed 
from survey files after the completion of data collection. 

Submitting the questionnaire and faculty lists. Please be sure to submit both items. You may submit each 
item as it is compieted — you do not have to return the iists and compiete the institution questionnaire at 
the same time. 

Questions. If you have any questions about who to include and exclude in your responses to the questions, or if 
you have other questions about the study, please contact Brian Kuhr at RTI. You can reach him toll free at 1- 
866-676-3274 (1-866-NSOFAS4) or by email at nsofas@rti.org. 

ASSURANCE OF CONFIDENTIALITY 

Federal law protects the confidentiality of survey responses. All responses that relate to or describe identifiable 
characteristics of individuals may be used only for statistical purposes and may not be disclosed, or used, in 
identifiable form for any other purpose unless otherwise compelled by law. All responses that permit the 
identification of individuals, will be protected by the National Education Statistics Act [Public Law 103-382, 20 
U.S.C. 9001 et seq.], as amended; the Privacy Act of 1 974 [5 U.S.C. 552a]; and other federal legislation. 
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2004 National Study of Postsecondary Faculty [Field Test] 
Institution Questionnaire Facsimile 



If your institution has multiple branches, answer only for the branch identified on the Web Site. If your 
institution/branch has schools (e.g., medical, law, etc.) or classes in more than one physical location, please be 
sure to include all faculty and instructional staff for these locations as well. 

Please be sure to include in your counts all faculty and instructional staff in all program areas (e.g., 
humanities, fine arts, social sciences, natural sciences, etc.). Remember also to include faculty and 
instructional staff from the health sciences. The health sciences include: dentistry, health services 
administration, medicine, nursing, pharmacy, public health, veterinary medicine, allied health technologies and 
services, and other health sciences. 

1 . As of November 1, 2002 (or during the Fall Term of the 2002-2003 academic year when your faculty 
lists are considered complete), how many full-time and part-time faculty and instructional staff were 
employed by your institution? Please report the total number of persons (i.e., a headcount), rather 
than full-time equivalents (FTEs). {Please write a number in each box; if none, write in “0”.) 

a. Full-time faculty and instructional staff 



b. Part-time faculty and instructional staff 



NOTE: By faculty and instructional staff we mean any faculty and instructional staff PLUS any other 
employees with instructional responsibilities, regardless of whether or not they have faculty status. 
Please see help for additional details. 



SPECIAL NOTE: The number of faculty and instructional staff reported in the Institution Questionnaire 
should be consistent with the number of personnel included on the List of Faculty and Instructional 
Staff that your institution prepares for NSOPF:04. If for some reason these counts are inconsistent, 
please explain the reason(s) for the inconsistency in the Comments section below. (See Guidance for 
Preparing List of Faculty and Instructional Staff provided in your folder.) If you have any questions or 
need assistance, please contact Brian Kuhr toll free at 1-866-676-3274 (1-866-NSOFAS4). 



Comments: 
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Section A. FULL-TIME FACULTY AND INSTRUCTIONAL STAFF 



Instructions: If you indicated your institution had any full-time faculty or instructional staff, begin with this 
section. If your institution did not have any full-time faculty or instructional staff, skip to Section B, Part-time 
Faculty and Instructional Staff. 



2 . 

a. 

b. 

c. 

d. 

e. 

f. 

g- 



Please provide the following information about changes in the number of full-time faculty and 
instructional staff between the 2001 and 2002 Fall Terms. (Write a number in each box; if none, write in “0”.) 

Total 

Number 



Total at start of 2001-2002 academic year (on or about November 1 , 2001) 

Number who changed from part-time to full-time status during 

2001-2002 academic year (between Nov. 1 , 2001 , and Nov. 1 , 2002) 

Number hired during 2001-2002 academic year 

Number retired between Nov. 1, 2001 and Nov. 1, 2002 

Number who left for other reasons during 2001-2002 academic year 

Number changed from full-time to part-time status during the 2001-2002 academic year... 
Total number as of Nov. 1 , 2002 (or at the start of the 2002-03 academic year) 




(Reminder — The total in row g should equal the number reported in Question 1a. If it does not, please explain.) 




3. Does your institution have a tenure system for any full-time faculty and instructional staff? 

(Mark [x] one box.) 

Yes, has a tenure system (Continue with Question 4.) 

Currently no tenure system, but still have tenured staff (Skip to Question 8.) 

No tenure system (Skip to Question 8.) 
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Note: If your institution does not have a tenure 
system for any full-time faculty and instructional staff, 
please skip to Question 8. 

4. During the 2001-2002 academic year (i.e., Faii 
2001 through Spring 2002), how many fuii- 
time facuity and instructionai staff at your 
institution were considered for tenure? (Please 
enter a number in the box; if none, enter “0”.) 

Number of full-time faculty and instruc- 
tional staff considered for tenure. 

5. Of those [FiLL, Q4] facuity members 
considered for tenure during the 2001-2002 
academic year, how many were granted 
tenure? (If none, write in “0”.) 

Number of faculty granted tenure 



6. For those on a tenure track but not tenured, 
what is the maximum number of years fuii- 
time facuity and instructionai staff can be on a 
tenure track and not receive tenure? (Write a 
number, in years, in the box; if no maximum, write 
in “NA”.) 



Years 



7. During the past five years, has your institution 



done any of the following? (Mark [x] one box for 

each item. When finished with this item, skip to 
Question 9.) 

Yes No 

T T 

Changed policy for granting tenure to 

full-time faculty and instructional staff O Q 


Made the standards more stringent for 
granting tenure to full-time faculty and 
instructional staff 


...□ 


□ 


Reduced the number of tenured full-time 
faculty and instructional staff through 
downsizing 


...□ 


□ 


Replaced some tenured or tenure-track full- 
time faculty and instructional staff with 
full-time faculty and instructional staff on 
fixed term contracts 


...□ 


□ 


Offered early or phased retirement to any 
tenured full-time faculty or instructional staff.. . 


...□ 


□ 



(IF YES to Question 7e ) Write in the number of full-time faculty 
and instructional staff who took early retirement during the past 
five years I I 



8. If your institution has no tenure system for 
faculty and instructional staff, did your 
institution discontinue tenure system within 
the last five years? 

(Please mark [x] one box.) 

Yes 
.... No 



9. How many full-time faculty and instructional 
staff positions was your institution seeking to 
fill for the 2002 Fall Term? 

(Write a number in the box; if none, write in “0”.) 



Number of full-fime positions 
seeking to fill for the 2002 Fall Term 



10. Indicate which of the following employee 
benefits are available at your institution to 
any full-time faculty or instructional staff. If 
available, indicate whether the benefit for the 
employee is subsidized by your institution. 
(Subsidized means paid for completely or in part by 
the institution.) (Mark [x] the appropriate box for each 
benefit.) 

Fully/Partially Not 

Subsidized Subsidized 

▼ ▼ 

a. Child care 

Yes 

No 

Don't Know 

b. Medical insurance for retirees 

Yes 

No 

Don't Know 

c. Cafeteria-style” benefits plan (a plan 
under which staff can trade off some 
benefits for others, following guidelines 
established by the institution) 

Yes 

No 

Don't Know 
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1 1 . Next, please indicate which of the following 
employee benefits or policies are available at 
your institution to any full-time faculty or 
instructional staff. 

(Mark [x] the appropriate box for each benefit.) 

Yes No 



a. Wellness program or health promotion Q Q 

b. Tuition remission/grants for spouse at 

this or other institutions O O 

c. Tuition remission/grants for children at this 

or other institutions O O 

d. Housing/mortgage; rent Q Q 

e. Transportation/parking Q Q 

f. Paid maternity leave Q Q 

g. Paid paternity leave Q Q 

h. Paid sabbatical leave Q Q 

i. Employee assistance program Q Q 



12. Are any of your full-time faculty and 
instructional staff legally represented by a 
union (or other association) for purposes of 
collective bargaining with your institution? 

Mark [x] one box 

Yes □ 

No □ 



13. Are any of the following used as part of 
institution or department/school policy in 
assessing the teaching performance of full- 
time instructional faculty/staff at this 
institution? 

(Mark [x] the appropriate boxes for each item; if you 
do not use or do not know about an assessment, 
check “Not Used” or "Don’t Know.”) 









Not 


Don't 






Used 


Used 


Know 






T 


T 


T 


a. 


Student evaluations 


□ 


□ 


□ 


b. 


Student test scores 


□ 


□ 


□ 


c. 


Student career placement 


□ 


□ 


□ 


d. 


Other measures of 
student performance 


□ 


□ 


□ 


e. 


Department/division chair 
evaluations 


□ 


□ 


□ 


f . 


Dean evaluations 


□ 


□ 


□ 


g- 


Peer evaluations 


□ 


□ 


□ 


h. 


Self-evaluations 


□ 


□ 


□ 
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Section B. PART-TIME FACULTY 
and INSTRUCTIONAL STAFF 

Instructions: If you indicated that your institution has 
part-time faculty or instructional staff (Question 1b), 
please continue with SECTION B, Question 14 below. 
Qtherwise, please skip to SECTION C. 

Reminder: Part-time refers to an individual’s 
employment status at the institution rather than to 
their assigned instructional responsibilities. 

14. Are any retirement plans available to part- 
time faculty or instructional staff at your 
institution? (Mark [x] one box.) 

I I Not available to any part-time faculty and instructional 
staff 

I I Yes, available to some part-time faculty and 
instructional staff 

I I Yes, available to most part-time faculty and 
instructional staff 

I I Yes, available to all part-time faculty and instructional 
staff 



15. Indicate which of the following employee 
benefits are available at your institution to any 
part-time faculty or instructional staff. If 
available, indicate whether the benefit for the 
employee is subsidized by your institution. 
(Subsidized means paid for completely or in part 
by the institution.) (Mark [x] the appropriate box; if 
you do not know if a benefit is available, check 
“Don’t Know. ’’) 

I I NA (Not applicable. No benefits available.) 

Fully/Partlally Not 

Subsidized Subsidized 

T ▼ 

a. Medical insurance or medical care 

Yes 

No 

Don’t Know 

b. Dental insurance or dental care 

Yes 

No 

Don’t Know 

c. Disability insurance program 

Yes 

No 

Don’t Know 

d. Life insurance 

Yes 

No 

Don’t Know 

e. Child care 

Yes 

No 

Don’t Know 

f. Medical insurance for retirees 

Yes 

No 

Don’t Know 

g. “Cafeteria-style” benefits plan (a plan under 
which staff can trade off some benefits for others, 
following guidelines established by the institution) 

Yes 

No 

Don't Know 



NSOPF:04 Field Test Methodology Report 



126 






Appendix B. Facsimile Instruments 



1 6. Next, indicate which of the foiiowing 

empioyee benefits or poiicies are avaiiabie to 
aii, some, or none of the part-time facuity or 
instructionai staff at your institution. (Mark[x] 
the appropriate box for each benefit; if you do not know 
if a benefit is available, check “Don’t Know.’’) 

I I NA (Not applicable. No benefits available.) 

Benefits/Policies available to : 





All 


Some 


None 


Don't 

Know 




T 


T 


T 


T 


a. Wellness program or health 

promotion 


□ 


□ 


□ 


□ 


b. Tuition remission/grants for spouse 
at this or other institutions 


□ 


□ 


□ 


□ 


c. Tuition remission/grants for 

children at this or other institutions 


□ 


□ 


□ 


□ 


d. Housing/mortgage; rent 


□ 


□ 


□ 


□ 


e. Transportation/parking 


□ 


□ 


□ 


□ 


f. Paid maternity leave 


□ 


□ 


□ 


□ 


g. Paid paternity leave 


□ 


□ 


□ 


□ 


h. Paid sabbatical leave 


□ 


□ 


□ 


□ 


i. Employee assistance program 


□ 


□ 


□ 


□ 



17. Are any of your part-time facuity and 
instructionai staff iegaiiy represented by a 
union (or other association) for purposes of 
coiiective bargaining with this institution? 

Mark [x] one box 

Yes.... 

No 



18. Are any of the foiiowing used as part of 
institution or department/schooi poiicy in 
assessing the teaching performance of part- 
time instructionai facuity/staff at this 
institution? (Mark [x] the appropriate boxes for each 
item; if you do not use or do not know, mark “Not 
Used” or “Don’t Know. ”) 









Not 


Don't 






Used 


Used 


Know 






T 


T 


T 


a. 


student evaluations 


□ 


□ 


□ 


b. 


Student test scores 


□ 


□ 


□ 


c. 


Student career placement 


□ 


□ 


□ 


d. 


Other measures of student 
performance 


□ 


□ 


□ 


e. 


Department/division 

chair evaluations 


□ 


□ 


□ 


f . 


Dean evaluations 


□ 


□ 


□ 


g- 


Peer evaluations 


□ 


□ 


□ 


h. 


Self-evaluations 


□ 


□ 


□ 



Section C. ALL FACULTY 
and INSTRUCTIONAL STAFF 

19. What percentage of undergraduate student 
credit hours were assigned to the foiiowing 
staff? Student credit hours are defined as the 
number of course credits or contact hours 
muitipiied by the number of students enroiied. 
(Write a percentage in each box; if none, write in “0”. 
Categories should sum to 100%.) 

I I Not applicable; no undergraduates (SKIP TO SECTION D 
on page 7) 



Percent of undergraduate 
instruction assigned to: 



.0% 


I a. Full-time faculty or instructional staff 






.0% 


I b. Part-time faculty or instructional 
I staff, including adjuncts 




.0% 


I c. Teaching assistants such as grad- 
I uate students who teach classes 






.0% 


I d. Others 



= 100% 
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D. RESPONDENT INFORMATION 

Instructions: Please fill in your name and title at this institution, as well as the names and titles of any other 
individuals who answered one or more questions in this questionnaire, and the question numbers each 
individual worked on. Please include telephone numbers in case we have questions about any entries. 

All Information that would permit identification of individuals, including names and telephone numbers, will be 
removed from survey files. 
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National Study of Postsecondary Faculty (NSOPF:04): Faculty Instrument Facsimile — Field Test 

^ BEGIN SECTION A: Nature of Employment 

Section: Nature of Employment 

Form: Q1 Label: Instructional duties, fall 2002 

Form Administered To: 

All faculty and instructional staff 

Stem Wording: 

During the 2002 Fall Term, did you have any instructional duties at [FILL INSTNAME], such as teaching 
one or more credit or noncredit courses, or advising students or supervising students' academic activities? 



0 = No 

1 = Yes 



Section: Nature of Employment 

Form: Q2 Label: Duties related to courses/advising, 2002 

Form Administered To: 

Faculty with instructional duties, fall 2002 

Stem Wording: 

Did any of your instructional duties include teaching credit courses, or advising students or supervising 
students' academic activities for which they received credit during the 2002 Fall Term? 



0 = No 

1 = Yes 



Section: Nature of Employment 

Form: Q3 Label: Have faculty status 2002 

Form Administered To: 

All faculty and instructional staff 

Stem Wording: 

During the 2002 Fall Term, did you have faculty status at [FILL INSTNAME]? 



0 = No 

1 = Yes 
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National Study of Postsecondary Faculty (NSOPF:04): Faculty Instrument Facsimile — Field Test 

Section: Nature of Employment 

Form: Q3X Label: Confirm study eligibility 

Form Administered To: 

Sample members without faculty status and with no instructional duties during the 2002 fall term 

Stem Wording: 

Just to confirm, you did not have faculty status and you did not teach any classes, or advise or supervise 
any students at [FILL INSTNAME] during the 2002 Fall Term? 

1 = Agree: NOT faculty and DID NOT have any instructional duties 

2 = Disagree: Had faculty status and/or had instructional duties 



Section: Nature of Employment 

Form: Q4 Label: Principal activity, fall 2002 

Form Administered To: 

All faculty and instructional staff 

Stem Wording: 

What was your principal activity at [FILL INSTNAME] during the 2002 Fall Term? Was your principal 
activity... (If you had equal responsibilities, please select one.) 

1 = Teaching 

2 = Research 

3 = Public service 

4 = Clinical service 

5 = Administration (e.g.. Dean, Chair, Director, etc.) 

6 = On sabbatical from this institution 

7 = Other activity (e.g., technical activity such as programmer or technician; other institutional activities 

such as library services; subsidized performer, artist-in-residence, etc.) 



Section: Nature of Employment 

Form: Q5 Label: Employed full time or part time 

Form Administered To: 

All faculty and instructional staff 

Stem Wording: 

During the 2002 Fall Term, did [FILL INSTNAME] consider you to be employed full time or part time? 

1 = Full time 

2 = Part time 
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National Study of Postsecondary Faculty (NSOPF:04): Faculty Instrument Facsimile — Field Test 



Section: Nature of Employment 

Form: Q6 Label: PT faculty: primary employment 

Form Administered To: 

Part-time faculty and instructional staff 

Stem Wording: 

Do you consider your part-time position at [FILL INSTNAME] to be your primary employment? 



0 = No 

1 = Yes 



Section: Nature of Employment 

Form: Q7 Label: PT faculty: years employed PT 

Form Administered To: 

Part-time faculty and instructional staff 

Stem Wording: 

How many years have you been employed part time at [FILL INSTNAME]? (If you have been employed 
part time at [FILL INSTNAME] for less than a year, enter "1.") 

* Years of part-time employment: 



Section: Nature of Employment 

Form: Q8 Label: PT faculty: preferred full-time position 

Form Administered To: 

Part-time faculty and instructional staff 

Stem Wording: 

Would you have preferred a full-time position for the 2002 Fall Term? 

0 = No 

1 = Yes 
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National Study of Postsecondary Faculty (NSOPF:04): Faculty Instrument Facsimile — Field Test 



Section: Nature of Employment 

Form: Q9 Label: Year started working current job 

Form Administered To: 

All faculty and instructional staff 

Stem Wording: 

In what year did you start working at the job you held during the 2002 Fall Term at [FILL INSTNAME]? 
Consider promotions in rank as part of the same job. 

* Year: 



Section: Nature of Employment 

Form: QIO Label: Academic rank 2002 

Form Administered To: 

All faculty and instructional staff 

Stem Wording: 

Which of the following best describes your academic rank, title, or position at [FILL INSTNAME] during the 
2002 Fall Term? 

(If no ranks are designated at your institution, select "Not applicable.") 

0 = Not applicable (No formal ranks are designated at this institution) 

1 = Professor 

2 = Associate professor 

3 = Assistant professor 

4 = Instructor 

5 = Lecturer 

6 = Other title (e.g.. Administrative, Adjunct, other) 



Section: Nature of Employment 

Form: Qll Label: Year attained current academic rank 

Form Administered To: 

Faculty and instructional staff who hold the rank of professor or associate professor 

Stem Wording: 

In what year did you first achieve the rank of [FILL QIO] at any institution? 

* Year: 
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National Study of Postsecondary Faculty (NSOPF:04): Faculty Instrument Facsimile — Field Test 



Section: Nature of Employment 

Form: Q12 Label: Tenure status 2002 

Form Administered To: 

All faculty and instructional staff 

Stem Wording: 

What was your tenure status at [FILL INSTNAME] during the 2002 Fall Term? Were you ... 

1 = Tenured 

2 = On tenure track but not tenured 

3 = Not on tenure track 

4 = Not tenured because institution had no tenure system 



Section: Nature of Employment 

Form: Q13 Label: Year attained tenure at any postsec Inst 

Form Administered To: 

Tenured faculty and instructional staff 

Stem Wording: 

In what year did you first achieve tenure at any postsecondary institution? 

* Year: 



Section: Nature of Employment 

Form: Q14 Label: Faculty union membership 

Form Administered To: 

All faculty and instructional staff 

Stem Wording: 

Are you a member of a union (or other bargaining association) that is legally recognized to represent the 
faculty at [FILL INSTNAME]? 

0 = No 

1 = Yes 
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National Study of Postsecondary Faculty (NSOPF:04): Faculty Instrument Facsimile — Field Test 
Section: Nature of Employment 

Form: Q15 Label: Reason why not a union member 

Form Administered To: 

Faculty who are not members of a union 

Stem Wording: 

Is that because a union is not available, you are not eligible to join, or you decided not to join? 

1 = Union is not available 

2 = Union is available, but I am not eligible 

3 = I am eligible, but I decided not to join 



Section: Nature of Employment 

Form: Q16VS Label: Principal field of teaching-verbatim 

Name: Q16VS1 Label: Principal field of teach-NA 

Form Administered To: 

All faculty and instructional staff 

Stem Wording: 

What is your principal field or discipline of teaching? 

(Enter the name of the principal field or discipline in the box below. If you have no principal 
field, select the "Not applicable" box.) 

* Name of principal field/discipline of teaching: 

* Not applicable (No principal teaching field or discipline) 
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Appendix B. Facsimile Instruments 



National Study of Postsecondary Faculty (NSOPF:04): Faculty Instrument Facsimile — Field Test 



Section: Nature of Employment 
Form: Q16CD 

Name: Q16CD2 Label: Principal field of teaching-CIP code 2 

Name: Q16CD4 Label: Principal field of teaching-CIP code 4 

Form Administered To: 

Faculty with a principal field of teaching 

Stem Wording: 

Next, please help us to categorize "[FILL Q16VS]" using the drop-down list boxes. 
(Please select a general area and a specific discipline within the general area.) 



* General Area: 

01 = Agriculture/natural resources/related 

02 = Architecture and related services 

03 = Area/ethnic/cultural/gender studies 

04 = Arts-visual and performing 

05 = Biological and biomedical sciences 

06 = Business/managementymarketing/related 

07 = Communication/journalism/comm, tech 

08 = Computer/info sciences/support tech 

09 = Construction trades 

10 = Education 

11 = Engineering technologies/technicians 

12 = English language and literature/letters 

13 = Family/consumer sciences, human sciences 

14 = Foreign languages/literature/linguistics 

15 = Health professions/clinical sciences 

16 = Legal professions and studies 

17 = Library science 

18 = Mathematics and statistics 

19 = Mechanical/repair technologies/techs 

20 = Multi/interdisciplinary studies 

21 = Parks/recreation/leisure/fitness studies 

22 = Precision production 

23 = Personal and culinary services 

24 = Philosophy, religion 8i theology 

25 = Physical sciences 

26 = Psychology 

27 = Public administration/social services 

28 = Science technologies/technicians 

29 = Security & protective services 

30 = Social sciences (except psychology) and 

history 

31 = Transportation & materials moving 

32 = Other 

* Specific Discipline: 

0101 = Agriculture and related sciences 



0102 = Natural resources and conservation 
0201 = Architecture and related services 
0301 = Area/ethnic/cultural/gender studies 

0401 = Art history, criticism & conservation 

0402 = Design 8i applied arts 

0403 = Drama/theatre arts and stagecraft 

0404 = Fine and studio art 

0405 = Music 

0406 = Music history, literature, and theory 

0407 = Visual and performing arts, other 

0408 = Commercial and advertising art 

0409 = Dance 

0410 = Film/video and photographic arts 

0501 = Biochem/biophysics/molecular biology 

0502 = Botany/plant biology 

0503 = Genetics 

0504 = Microbiological sciences & immunology 

0505 = Physiology, pathology 8i related sciences 

0506 = Zoology/animal biology 

0507 = Biological 8i biomedical sciences, other 

0601 = Accounting and related services 

0602 = Business admin/management/operations 

0603 = Business operations support/assistance 

0604 = Finance/financial management services 

0605 = Human resources management and svcs 

0606 = Marketing 

0607 = Business/mgt/marketing/related, other 

0608 = Management information systems/services 

0701 = Communication/journalism/related pgms 

0702 = Communication technologies 

0801 = Computer/info tech administration/mgmt 

0802 = Computer programming 

0803 = Computer science 

0804 = Computer software and media applications 

0805 = Computer systems analysis 

0806 = Computer systems networking/telecomm 

0807 = Data entry/microcomputer applications 

0808 = Data processing 

0809 = Information science/studies 
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National Study of Postsecondary Faculty (NSOPF:04): Faculty Instrument Facsimile — Field Test 



0810 = Computer/info sci/support svcs, other 
0901 = Construction trades 

1001 = Curriculum and instruction 

1002 = Educational administration/supervision 

1003 = Educational/instructional media design 

1004 = Special education and teaching 

1005 = Student counseling/personnel services 

1006 = Education, other 

1007 = Early childhood education and teaching 

1008 = Elementary education and teaching 

1009 = Secondary education and teaching 

1010 = Adult and continuing education/teaching 

1011 = Teacher ed: specific levels, other 

1012 = Teacher ed: specific subject areas 

1013 = Bilingual & multicultural education 

1014 = Ed assessment 

1015 = Higher education 

1101 = Biomedical/medical engineering 

1102 = Chemical engineering 

1103 = Civil engineering 

1104 = Computer engineering 

1105 = Electrical/electronics/comms engineering 

1106 = Engineering technologies/technicians 

1107 = Environmental/environmental health eng 

1108 = Mechanical engineering 

1109 = Engineering, other 

1201 = English language and literature/letters 
1301 = Family/consumer sciences, human svcs 
1401 = Foreign languages/literature/linguistics 

1501 = Alternative/complementary medicine/sys 

1502 = Chiropractic 

1503 = Clinical/medical lab science/allied 

1504 = Dental support services/allied 

1505 = Dentistry 

1506 = Health 8i medical administrative services 

1507 = Health/medical services/allied health 

1508 = Health/medical technicians/technologists 

1509 = Medicine, including psychiatry 

1510 = Mental/social health services and allied 

1511 = Nursing 

1512 = Optometry 

1513 = Osteopathic medicine/osteopathy 

1514 = Pharmacy/pharmaceutical 

sciences/admin 

1515 = Podiatric medicine/podiatry 

1516 = Public health 

1517 = Rehabilitation 8i therapeutic professions 

1518 = Veterinary medicine 

1519 = Health/related clinical services, other 



1601 = Law 

1602 = Legal support services 

1603 = Legal professions and studies, other 
1701 = Library science 

1801 = Mathematics 

1802 = Statistics 

1901 = Mechanical/repair technologies/techs 
2001 = Multi/interdisciplinary studies 

2101 = Parks, recreation and leisure studies 

2102 = Health and physical education/fitness 
2201 = Precision production 

2301 = Culinary arts and related services 

2302 = Personal and culinary services 

2401 = Philosophy 

2402 = Religion/religious studies 

2403 = Theology 

2501 = Astronomy & astrophysics 

2502 = Atmospheric sciences and meteorology 

2503 = Chemistry 

2504 = Geological 8i earth sciences/geosciences 

2505 = Physics 

2506 = Physical sciences, other 

2601 = Behavioral psychology 

2602 = Clinical psychology 

2603 = Education/school psychology 

2604 = Psychology, other 

2701 = Public administration 

2702 = Social work 

2703 = Public administration & social svcs oth 
2801 = Science technologies/technicians 

2901 = Corrections 

2902 = Criminal justice 

2903 = Fire protection 

2904 = Police science 

2905 = Security and protective services, other 

3001 = Anthropology (except psychology) 

3002 = Archeology 

3003 = Criminology 

3004 = Demography 8i population studies 

3005 = Economics 

3006 = Geography 8i cartography 

3007 = History 

3008 = International relations & affairs 

3009 = Political science and government 

3010 = Sociology 

3011 = Urban studies/affairs 

3012 = Social sciences, other 

3101 = Transportation & materials moving 
3201 = Other 
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National Study of Postsecondary Faculty (NSOPF:04): Faculty Instrument Facsimile — Field Test 

^ BEGIN SECTION B: Academic/ Professional Background 

Section: Academic/Professional Background 

Form: Q17al Label: Highest degree type 

Form Administered To: 

All faculty and instructional staff 

Stem Wording: 

The next questions pertain to degrees you have earned, starting with your highest degree. 

Do not include honorary degrees. 

What is the highest degree you have completed? 

(If you have none of the degrees or awards listed below, select "Not applicable.") 

0 = Not applicable (Do not hold a degree) 

1 = Doctoral degree (Ph.D., Ed.D., etc.) 

2 = First-professional degree (M.D., D.O., D.D.S or D.M.D., LL.B., J.D., D.C. or D.C.M., Pharm.D., Pod.D. 

or D.P., D.V.M., O.D., M.Div. or H.H.L or B.D.) 

3 = Master of Fine Arts, Master of Social Work (M.F.A., M.S.W.) 

4 = Other master's degree (M.A., M.S., M.B.A, M.Ed., etc.) 

5 = Bachelor's degree (B.A., A.B., B.S., etc.) 

6 = Associate's degree or equivalent (A. A., A.S., etc.) 

7 = Certificate or diploma for completion of undergraduate program (other than associate's or 

bachelor's) 



Section: Academic/Professional Background 

Form: Q17a2 Label: Year received highest degree 

Form Administered To: 

Faculty who completed a postsecondary degree 

Stem Wording: 

In what year did you receive your [FILL HIGHEST_DEGREE]? 

(If you have more than one degree at the same level, please select the most recent degree.) 
* Year received: 



Section: Academic/Professional Background 

Form: Q17a3VS Label: Highest degree field-verbatim 

Form Administered To: 

Faculty who hold a postsecondary degree 

Stem Wording: 

In what field or discipline was your [FILL HIGHEST_DEGREE]? 
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National Study of Postsecondary Faculty (NSOPF:04): Faculty Instrument Facsimile — Field Test 

Section: Academic/Professional Background 
Form: Q17a3CD 

Name: Q17a3CD2 Label: Highest degree field-CIP code 2 

Name: Q17a3CD4 Label: Highest degree fieid-CIP code 4 

Form Administered To: 

Facuity who hoid a postsecondary degree and provided a verbatim fieid/discipiine string 

Stem Wording: 

Piease heip us categorize "[FILL Q17a3VS]" using the drop-down iist boxes beiow. 

If Q16CD gt 0 dispiay this wording: (Seiect one from the iist of disci pi ines you've a i ready toid us about:) 
(Seiect a genera i area and a specific disci pi ine within the area.) 

* Genera i Area: 

* Specific Discipiine: 

Note: Piease refer to the compiete iist of instructionai program codes on pages 6-8. 



Section: Academic/Professionai Background 



Form: Q17a4 
Name: Q17a4ST 
Name: Q17a4C 

Name: Q17a4N 

Form Administered To: 

Facuity who hoid a postsecondary degree 



Label: Highest degree institution-state 
Label: Highest degree institution-city 
Label: Highest degree institution-name 



Stem Wording: 

Piease heip us code the postsecondary institution that awarded your 
[FILL HIGHEST_DEGREE] by providing the state and city in which it was 
iocated as weii as the name of the institution. 



(Steps: 

1. Piease seiect the state in which the schooi was iocated. If the schooi 
was iocated in another country, piease enter "foreign country." 

2. Enter the name of the city in which the institution was iocated. You 
can aiso use the "Browse" button to identify the city. 

3. Seiect the "Search" button to iist the schoois iocated in that state and 
city. 

4. Seiect the desired schooi that matches the city and state. 

Problems? If you can't find the schooi on the iist, try searching for it by state without iisting a city or a 
schooi name. If you attended a foreign schooi, or if you stiii can't find the schooi, seiect the "UnalDie To 
Find Schooi in List" button at the bottom of the search resuits and we wiii ask for information that wiii heip 
us code the schooi iater.) 
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National Study of Postsecondary Faculty (NSOPF:04): 


Faculty Instrument Facsimile — Field Test 


* State: 




01 = Alabama 


31 = New Jersey 


02 = Alaska 


32 = New Mexico 


03 = Arizona 


33 = New York 


04 = Arkansas 


34 = North Carolina 


05 = California 


35 = North Dakota 


06 = Colorado 


36 = Ohio 


07 = Connecticut 


37 = Oklahoma 


08 = Delaware 


38 = Oregon 


09 = District of Columbia 


39 = Pennsylvania 


10 = Florida 


40 = Rhode Island 


11 = Georgia 


41 = South Carolina 


12 = Hawaii 


42 = South Dakota 


13 = Idaho 


43 = Tennessee 


14 = Illinois 


44 = Texas 


15 = Indiana 


45 = Utah 


16 = Iowa 


47 = Virginia 


17 = Kansas 


48 = Washington 


18 = Kentucky 


49 = West Virginia 


19 = Louisiana 


50 = Wisconsin 


20 = Maine 


51 = Wyoming 


21 = Maryland 


52 = Puerto Rico 


22 = Massachusetts 


54 = American Samoa 


23 = Michigan 


55 = Guam 


24 = Minnesota 


56 = Fed State Micronesia 


25 = Mississippi 


57 = Marshall Islands 


26 = Missouri 


58 = Northern Mariana Isl 


27 = Montana 


59 = Palau 


28 = Nebraska 


60 = Virgin Islands 


29 = Nevada 


63 = Foreign country 


30 = New Hampshire 





* City: 

* School Name: 



Section: Academic/Professional Background 

Form: Q17b Label: Hold PhD in addition to professional degree 

Form Administered To: 

Faculty with a first professional degree 

Stem Wording: 

Do you also hold a PhD or other doctoral degree? 



0 = No 

1 = Yes 
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National Study of Postsecondary Faculty (NSOPF:04): Faculty Instrument Facsimile — Field Test 



Section: Academic/Professional Background 

Form: Q17c Label: Year received doctoral degree 

Form Administered To: 

Faculty who reported a professional degree as their highest degree but who also have a doctoral degree 

Stem Wording: 

In what year did you receive this doctoral degree? 

* Year received: 



Section: Academic/Professional Background 

Form: Q17c2VS Label: Doctoral field-verbatim 

Form Administered To: 

Faculty who reported a professional degree as their highest degree but who also have a doctoral degree 

Stem Wording: 

In what field or discipline was this doctoral degree? 



Section: Academic/Professional Background 
Form: Q17c2CD 

Name: Q17c2CD2 Label: Doctoral field-CIP code-2 

Name: Q17c2CD4 Label: Doctoral field-CIP code-4 

Form Administered To: 

Faculty who reported a professional degree as their highest degree but who also have a doctoral degree 
who provided the verbatim field/discipline string for their doctoral degree 

Stem Wording: 

Please help us categorize "[FILL Q17c2VS]" using the drop-down list boxes below. 

If Q16CD or Q17A3CD gt 0 display this wording: 

(Select one from the list of disciplines you've already told us about:) 

(Select a general area and a specific discipline within the area.) 

* General Area: 

* Specific Discipline: 

Note: Please refer to the complete list of instructional program codes on form Q16CD. 
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National Study of Postsecondary Faculty (NSOPF:04): Faculty Instrument Facsimile — Field Test 

Section: Academic/Professional Background 
Form: Q17c3 

Name: Q17c3S Label: 

Name: Q17c3C Label: 

Name: Q17c3N Label: 

Form Administered To: 

Faculty who reported a professional degree as their highest degree but who also have a doctoral degree 

Stem Wording: 

Please help us code the postsecondary institution that awarded your doctoral degree by providing the 
state and city in which it was located as well as the name of the institution. 

[IF AN INSTITUTION WAS NAMED IN Q17A4] 

(Select one from the list of schools you've already told us about:) 

- or - 

(Steps: 

1 . Please select the state in which the school was located. If the school was located in another country, 
please enter "foreign country." 

2 . Enter the name of the city in which the institution was located. You can also use the "Browse" button 
to identify the city. 

3 . Select the "Search" button to list the schools located in that state and city. 

4 . Select the desired school that matches the city and state. 

Problems? If you can't find the school on the list, try searching for it by state without listing a city or a 
school name. If you attended a foreign school, or if you still can't find the school, select the "Unable To 
Find School in List" button at the bottom of the search results and we will ask for information that will help 
us code the school later.) 

* State: 

* City: 

* School Name: 

Note: Please refer to the complete list of state codes on pages 11. 



Doctoral institution-state 
Doctoral institution-city 
Doctoral institution-name 



Section: Academic/Professional Background 
Form: Q17d 

Name: Q17dl Label: Year received bachelor's degree 

Name: Q17dla Label: BA degree-not applicable 

Form Administered To: 

Faculty who reported their highest degree as master's level or above 

Stem Wording: 

Please tell me next about your bachelor's degree. 

In what year did you receive this degree? 

* Year received: 

* Not applicable (Do not hold a bachelor's degree) 
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National Study of Postsecondary Faculty (NSOPF:04): Faculty Instrument Facsimile — Field Test 

Section: Academic/Professional Background 
Form: Q17D2 

Name: Q17d2S Label: 

Name: Q17d2C Label: 

Name: Q17d2N Label: 

Form Administered To: 

Faculty who reported their highest degree as master's level or above 

Stem Wording: 

What school awarded your bachelor's degree? 

[IF AN INSTITUTION WAS NAMED IN Q17A4 or Q17C3] 

(Select one from the list of schools you've already told us about:) 



Bachelor degree institution-state 
Bachelor degree institution-city 
Bachelor degree institution-name 



- or - 



(Identify your school by selecting the state the school is in, optionally entering the city and/or a unique 
part of the school name, and clicking the "Search" button. The more information you provide, the less time 
the school list will take to load. After the school list appears, click on your school's name. If your school 
isn't listed, try searching with no city or no school name. If you still can't find the school, click the "Unable 
To Find School in List" button at the bottom of the list of search results.) 

* State: 

* City: 

* School Name: 

Note: Please refer to the complete list of state codes on form Q17a4. 



Section: Academic/Professional Background 

Form: Q18 Label: Other employment, not consulting 

Form Administered To: 

All faculty and instructional staff 

Stem Wording: 

During the 2002 Fall Term, were you employed anywhere other than [FILL INSTNAME]? Please do not 
consider any outside consulting jobs. 



0 = No 

1 = Yes 
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National Study of Postsecondary Faculty (NSOPF:04): Faculty Instrument Facsimile — Field Test 

Section: Academic/Professional Background 
Form: Q19A 

Name: Q19A1 Label: Full-time positions outside PSE 

Name: Q19A2 Label: Part-time positions outside PSE 

Form Administered To: 

Faculty with other employment (excluding consulting) 

Stem Wording: 

Please answer the following questions about the other jobs you held during the 2002 Fall Term. 

How many full- and part-time jobs outside of a postsecondary institution did you have during the 
2002 Fall Term? (Do not count outside consulting jobs. If none, select "0.") 

* Full-time jobs 

* Part-time jobs 



0 = 0 
1 = 1 
2 = 2 

3 = 3 

4 = 4 

5 = 5 



Section: Academic/Professional Background 
Form: Q19B 

Name: Q19B1 Label: Full-time positions at other PSE 

Name: Q19B2 Label: Part-time positions at other PSE 

Form Administered To: 

Faculty with other employment (excluding consulting) 

Stem Wording: 

Aside from your position at [FILL INSTNAME], how many other full- and part-time faculty and 
instructional positions did you hold at postsecondary institutions during the 2002 Fall Term? (If none, 
select "0.") 

* Full-time jobs 

* Part-time jobs 

0 = 0 
1 = 1 
2 = 2 

3 = 3 

4 = 4 

5 = 5 
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National Study of Postsecondary Faculty (NSOPF:04): Faculty Instrument Facsimile — Field Test 

Section: Academic/Professional Background 
Form: Q19C 

Name: Q19C1 Label: Number classes taught FT at other PSE 

Name: Q19C2 Label: Number classes taught PT at other PSE 

Form Administered To: 

Faculty with instructional employment at other postsecondary institutions 

Stem Wording: 

[If Q19bl>0 and Q19b2 >0 ASK THIS WAYJNot including classes you taught at 
[FILL INSTNAME], how many classes did you teach at postsecondary institutions during the 2002 Fall 
Term? Please distinguish the number of classes you taught at your full-time and part-time positions. (If 
none, select "0.") 

[ELSE ASK THIS WAYJNot including classes you taught at [FILL INSTNAME], how many classes did you 
teach at postsecondary institutions during the 2002 Fall Term? (If none, select "0.") 

* Classes taught at full-time jobs 

* Classes taught at part-time jobs 

0 = 0 
1 = 1 
2 = 2 

3 = 3 

4 = 4 

5 = 5 

6 = 6 

7 = 7 

8 = 8 

9 = 9 

10 = 10 



Section: Academic/Professional Background 

Form: Q20 Label: Non-PSE jobs related to teaching field 

Form Administered To: 

Faculty with instructional duties during the 2002 fall term who held a position outside of a postsecondary 
institution 

Stem Wording: 

[IF Q19Al-i-Q19A2=l ASK THIS WAYJWould you say your job outside of a postsecondary institution during 
the 2002 Fall Term was highly related, somewhat related, or not related to your principal field of teaching 
at [FILL INSTNAME]? 

[ELSE ASK THIS WAYJWould you say your jobs outside of a postsecondary institution during the 2002 Fall 
Term were highly related, somewhat related, or not related to your principal field of teaching at [FILL 
INSTNAME]? 

1 = Highly related 

2 = Somewhat related 

3 = Not related 
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National Study of Postsecondary Faculty (NSOPF:04): Faculty Instrument Facsimile — Field Test 
Section: Academic/Professional Background 

Form: Q21 Label: First post-degree PSE faculty position 

Form Administered To: 

All faculty and instructional staff 

Stem Wording: 

Is your current job at [FILL INSTNAME] the first faculty or instructional staff position you have held at a 
postsecondary institution? 

Do not include teaching assistant or research assistant positions while you were working on your degree. 



0 = No 

1 = Yes 



Section: Academic/Professional Background 

Form: Q22 Label: Total number of PSE employed as faculty 

Form Administered To: 

Faculty who have taught at another postsecondary institution since degree completion 

Stem Wording: 

Including [FILL INSTNAME], at how many postsecondary institutions have you been employed as a 
faculty or instructional staff member? (Do not include institutions where you were a teaching or research 
assistant.) 

* Number of institutions including current institution: 

1 = 1 
2 = 2 

3 = 3 

4 = 4 

5 = 5 

6 = 6 

7 = 7 

8 = 8 
9 = 9 

10 = 10 
11 = 11 
12 = 12 

13 = 13 

14 = 14 

15 = 15 

16 = 16 

17 = 17 

18 = 18 

19 = 19 

20 = 20 
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National Study of Postsecondary Faculty (NSOPF:04): Faculty Instrument Facsimile — Field Test 
Section: Academic/Professional Background 

Form: Q23 Label: First PSE faculty position-year began 



Form Administered To: 

Faculty who have taught at another postsecondary institution since degree completion 

Stem Wording: 

In what year did you begin your first faculty or instructional staff position at a postsecondary institution? 
(Do not include time when you were a teaching or research assistant.) 

* Year: 



Section: Academic/Professional Background 

Form: Q24 Label: First PSE faculty position-PT or FT 



Form Administered To: 

All faculty and instructional staff 

Stem Wording: 

[IF Q21=l ASK THIS WAYJWhen you first started your job at [FILL INSTNAME], were you employed full 
time or part time? 

[ELSE ASK THIS WAYjWere you employed full time or part time at your first faculty or 
instructional staff position? 

1 = Full time 

2 = Part time 



Section: Academic/Professional Background 

Form: Q25 Label: First PSE faculty position-academic rank 

Form Administered To: 

Faculty who were employed full-time in their first faculty job, except if this is their first instructional 
position and they told us that there are no formal ranks at this institution 

Stem Wording: 

[IF Q21=l ASK THIS WAYJWhen you first started your job at [FILL INSTNAME], what was your academic 
rank, title, or position? 

[ELSE ASK THIS WAYJWhen you started working at your first faculty or instructional staff job, what was 
your academic rank, title, or position? 

(If no ranks are designated at that institution, select "Not applicable.") 

0 = Not applicable (No formal ranks designated at the institution) 

1 = Professor 

2 = Associate professor 

3 = Assistant professor 

4 = Instructor 

5 = Lecturer 

6 = Other title (e.g.. Administrative, Adjunct, other) 
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Appendix B. Facsimile Instruments 



National Study of Postsecondary Faculty (NSOPF:04): Faculty Instrument Facsimile — Field Test 
Section: Academic/Professional Background 

Form: Q26 Label: First faculty position-tenure status 

Form Administered To: 

Faculty who were employed full-time in their first faculty job, except if this is their first instructional 
position and they told us that there is no tenure system at this institution 

Stem Wording: 

[If Q21=l ASK THIS WAYJWhen you first started your job at [FILL INSTNAME], what was your tenure 
status? Were you... 

[ELSE ASK THIS WAYJWhen you started working at your first faculty or instructional staff job at a 
postsecondary institution, what was your tenure status? Were you... 

1 = Tenured 

2 = On tenure track but not tenured 

3 = Not on tenure track 

4 = Not tenured because institution had no tenure system 



Section: Academic/Professional Background 

Form: Q27 Label: Held positions outside PSE 

Form Administered To: 

Faculty and instructional staff who did not hold jobs outside of a postsecondary institution during the 2002 
fall term 

Stem Wording: 

Since receiving your highest degree, have you held any positions outside of postsecondary institutions? 



0 = No 

1 = Yes 



Section: Academic/Professional Background 

Form: Q28 Label: Employment sector of prior job 

Form Administered To: 

Faculty and instructional staff who have potentially held a prior job 

Stem Wording: 

Now we would like to know about the job you held immediately prior to your current job at [FILL 
INSTNAME]. Was the job in a... 

0 = Not applicable (No job immediately prior to this one) 

1 = 4- or 2-year postsecondary institution 

2 = Elementary or secondary school 

3 = Hospital or other health care organization or clinical setting 

4 = Foundation or other non-profit organization other than health care organization 

5 = For-profit business or industry in the private sector 

6 = Government (federal, state, or local) or military organization (excluding schools and hospitals) 

7 = Other organization 
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Appendix B. Facsimile Instruments 



[National Study of Postsecondary Faculty (NSOPF:04): Faculty Instrument Facsimile — Field Test 

Section: Academic/Professional Background 

Form: Q29 Label: Previous job related to teaching field 

Form Administered To: 

Faculty and instructional staff who are teaching in 2002 Fall Term and who had a job prior to their current 
job 

Stem Wording: 

Was your occupation in this previous job highly related, somewhat related, or not related to your current 
principal field of teaching at [FILL INSTNAME]? 

1 = Highly related 

2 = Somewhat related 

3 = Not related 



Section: Academic/Professional Background 

Form: Q30 Label: Years teaching in PSE institutions 

Form Applies to: 

All faculty and instructional staff 

Stem Wording: 

How many years have you been teaching in postsecondary institutions? Do 
not include years spent as a teaching assistant. 

(If you have never taught, please enter "0." If you have taught for 
less than a year, please enter "1.") 

* Years of teaching: 
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Appendix B. Facsimile Instruments 



National Study of Postsecondary Faculty (NSOPF:04): Faculty Instrument Facsimile — Field Test 

^ BEGIN SECTION C: Institutional Responsibilities and Workload 

Section: Institutional Workload 



Form: 


Q31 






Name: 


Q31a 


Label: 


Hours per week: paid tasks at inst 


Name: 


Q31b 


Label: 


Hours per week: unpaid tasks at inst 


Name: 


Q31c 


Label: 


Hours per week: paid tasks not at inst 


Name: 


Q31d 


Label: 


Hours per week: unpaid tasks not at inst 



Form Administered To: 

All faculty and instructional staff 

Stem Wording: 

This next section of the questionnaire relates to your responsibilities on the job and your workload. 

On average, how many hours per week did you spend at each of the following kinds of activities during 
the 2002 Fall Term? 

(Enter average number of hours. If not sure, give your best estimates. If none, enter "0.") 

* a. All paid activities at [FILL INSTNAME] (e.g., teaching, clinical service, class preparation, research, 

administration) 

* b. All unpaid activities at [FILL INSTNAME] (e.g., club assistance, recruiting, attending institution 

events) 

* c. Any other paid activities outside [FILL INSTNAME] including consulting, working at other jobs, 

teaching at other schools 

* d. Unpaid (pro bono) professional service activities outside [FILL INSTNAME] 
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National Study of Postsecondary Faculty (NSOPF:04): Faculty Instrument Facsimile — Field Test 



Section: 


: Institutional Responsibilities and Workload 






Form: 


Q32 








Name: 


Q32a 


Label: 


Percent time: 


instructional activities 


Name: 


Q32b 


Label: 


Percent time: 


research activities 


Name: 


Q32c 


Label: 


Percent time: 


other activities 



Form Administered To: 

All faculty and instructional staff 

Stem Wording: 

[IF Q31SUM GT 0 USE THIS WORDING] 

For the [FILL Q31SUM] hours per week you worked during the 2002 Fall Term at [FILL INSTNAME] and 
at other jobs, we would like you to allot this time— using percentages— into three broad categories: 
Instruction, Research, and Other Activities like professional growth, administration, and service. (For 
example, someone may spend 50 percent of his/her time on instructional activities, 30 percent on 
research, and 20 percent on other activities.) If you are not sure, give your best estimate. 

(The percentages should sum to 100%. If none, enter "0.") 

What percentage of your time was spent on... 

[ELSE (THE CASE WHERE Q31 IS BLANK OR ZERO)] 

For the hours each week you worked during the 2002 Fall Term at [FILL INSTNAME] and at other 
jobs, we would like you to allot this time— using percentages— into three broad categories: Instruction, 
Research, and Other Activities like professional growth, administration, and service. (For example, 
someone may spend 50 percent of his/her time on instructional activities, 30 percent on research, and 20 
percent on other activities.) If you are not sure, give your best estimate. 

(The percentages should sum to 100%. If none, enter "0.") 

What percentage of your time was spent on... 

* a. Instructional Activities, including teaching, preparing for classes, advising, and supervising students at 

this or any other institution or organization? 

* b. Research Activities, other forms of scholarship, or grants, regardless of where the research took 

place? 

* c. Other Activities, like administration, service, and any other activities not related to teaching and 

research at this or any other institution or organization? 
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Appendix B. Facsimile Instruments 



National Study of Postsecondary Faculty (NSOPF:04): Faculty Instrument Facsimile — Field Test 



Section: Institutional Responsibilities and Workload 

Form: Q33 

Name: Q33a Label: Percent instruction time: undergraduate 

Name: Q33b Label: Percent instruction time: graduate 

Form Administered To: 

Faculty who spent time on instructional activities 

Stem Wording: 

Next, please consider only the time you spent on instructional activities during the 2002 Fall Term at 
[FILL INSTNAME] and/or any other institution. For your instructional activities, how much was 
allotted to undergraduates, and how much was allotted to graduate and first professional students? The 
two percentages should sum to 100%. 

* a. Time spent on Undergraduate instruction (including teaching, preparing for classes, developing 

curricula, and advising or supervising students) 

* b. Time spent on Graduate/ First Professional instruction (including teaching, preparing for classes, 

developing curricula, and advising or supervising students) 



Section: Institutional Responsibilities and Workload 



Form: 


Q34 








Name: 


Q34a 


Label: 


Percent other time: 


administration 


Name: 


Q34b 


Label: 


Percent other time: 


professional growth 


Name: 


Q34c 


Label: 


Percent other time: 


service 


Name: 


Q34d 


Label: 


Percent other time: 


other activities 


Name: 


Q34dsp 


Label: 


Percent other time: 


other activ specify 



Form Administered To: 

Faculty who spent time on activities other than instruction and research 

Stem Wording: 

Finally, of the time you spent on activities other than instruction and research during the fall term at 
[FILL INSTNAME] or any other institution, what percentage did you spend in the following four 
areas: Administration, Professional Growth, Service, and Other Activities not related to 
research and instruction and not included above. The percentages should sum to 100%. 

What percent of your non-research and non-teaching time did you spend on... 

* a. Administration (including departmental or institution-wide meetings or committee work)? 

* b. Professional Growth (for example, taking courses, pursuing an advanced degree, or other activities to 

remain current in your field)? 

* c. Service (such as paid or unpaid community or public service; service to professional associations)? 

* d. Other Activities not included above? 

(Please specify what those other activities were) 
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National Study of Postsecondary Faculty (NSOPF:04): Faculty Instrument Facsimile — Field Test 

Section: Institutional Responsibilities and Workload 
Form: Q35A 

Name: Q35al Label: Credit classes taught 

Name: Q35a2 Label: Non-credit classes taught 

Form Administered To: 

All faculty and instructional staff 

Stem Wording: 

How many classes or sections did you teach during the 2002 Fall Term at [FILL INSTNAME]? Please 
include courses for credit and courses not-for-credit towards degrees. (If none, select "no classes.") 

*Count multiple sections of the same course separately (e.g., Sociology 101 taught to two different groups 
of students would count as two classes). 

*Count lab or discussion sections as part of the same class (e.g., a biology class with lectures, labs, and 
discussion sections each week counts as one class) 

^Please Note: Do not include individualized instruction. Questions about independent study, intern 
supervision, and one-on-one instruction in performance, clinical, or research settings come later. 

* For credit towards degree: 

* Not-for-credit towards degree: 

0 = No classes 

1 = 1 class 

2 = 2 classes 

3 = 3 classes 

4 = 4 classes 

5 = 5 classes 

6 = 6 classes 

7 = 7 classes 

8 = 8 classes 

9 = 9 classes 

10 = 10 classes 

11 = 11 classes 

12 = 12 classes 

13 = 13 classes 

14 = 14 classes 

15 = 15 classes 

16 = 16 classes 

17 = 17 classes 

18 = 18 classes 

19 = 19 classes 

20 = 20 or more classes 
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Appendix B. Facsimile Instruments 



National Study of Postsecondary Faculty (NSOPF:04): Faculty Instrument Facsimile — Field Test 



Section: Institutional Responsibilities and Workload 
Form: Q35B 

Name: Q35bl Label: Remedial credit classes taught 

Name: Q35b2 Label: Remedial non-credit classes taught 

Form Administered To: 

Faculty who taught at least one class 

Stem Wording: 

Of these classes you taught at [FILL INSTNAME] in the 2002 Fall Term, how many were remedial or 
developmental classes? 

(Please select the Help button for guidance on how to "count" different types of classes or sections of 
classes.) 

* For credit towards degree: 

* Not-for-credit towards degree: 

0 = No classes 

1 = 1 class 

2 = 2 classes 

3 = 3 classes 

4 = 4 classes 

5 = 5 classes 

6 = 6 classes 

7 = 7 classes 

8 = 8 or more classes 



Section: Institutional Responsibilities and Workload 
Form: Q35C 

Name: Q35C1 Labei: Distance education credit classes taught 

Name: Q35C2 Labei: Distance ed non-credit classes taught 

Form Administered To: 

Faculty who taught at least one class 

Stem Wording: 

Again, thinking about all the classes you taught in the 2002 Fall Term at [FILL INSTNAME], how many 
classes did you teach through distance education, either exclusively or primarily? 

(Please select the Help button for guidance on how to "count" different types of classes or sections of 
classes.) 

* For credit towards degree: 

* Not-for-credit towards degree: 

0 = No classes 

1 = 1 class 

2 = 2 classes 

3 = 3 classes 

4 = 4 classes 

5 = 5 classes 

6 = 6 classes 

7 = 7 classes 

8 = 8 or more classes 
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Appendix B. Facsimile Instruments 

National Study of Postsecondary Faculty (NSOPF:04): Faculty Instrument Facsimile — Field Test 
Section: Institutional Responsibilities and Workload 

Form: Q36 Label: Have teaching assistant for credit class 

Form Administered To: 

Faculty who taught at least one class for credit 

Stem Wording: 

[IF q35Al=l]Did you have teaching assistants, readers, graders, or lab assistants for the credit class you 
taught during the 2002 Fall Term? 

[ELSEJDid you have teaching assistants, readers, graders, or lab assistants for any of the credit classes 
you taught during the 2002 Fall Term? 



0 = No 

1 = Yes 



Section: Institutional Responsibilities and Workload 



Form: 


Q37 (loops for up to eight classes) 




Number of weeks i‘^ credit class 


Name: 


Q37ai (i= 1 to 8) 


Label: 


Name: 


Q37bi (1= 1 to 8) 


Label: 


Number of credit hours for i‘^ class 


Name: 


Q37q (1= 1 to 8) 


Label: 


Number of hours per week i‘*^ class met 


Name: 


Q37di (1= 1 to 8) 


Label: 


Number of students i‘^ class 


Name: 


Q37ei (1= 1 to 8) 


Label: 


Primary level of students in i‘^ class 


Name: 


Q37fi (i= 1 to 8) 


Label: 


Teaching assistant for i‘^ class 



Form Administered To: 

Faculty who taught at least one class for credit 

Stem Wording: 

[IF KQ35A1] 

For each of the [FILL Q35al] credit classes or sections that you reported teaching at 
[FILL INSTNAME] during the 2002 Fall Term, please answer the following questions. 

(Please select the Help button for guidance on what types of classes are relevant.) 

[IF Q35A1>8 ASK THIS WAY] 

You reported earlier that you taught [FILL Q35A1] classes for credit during the 2002 Fall Term at [FILL 
INSTNAME]. We have space for you to describe 8 of these classes. Please select the 8 classes that are 
most representative of your instructional activities. 

(Please select the Help button for guidance on what types of classes are relevant.) 

[ELSE (JUST ONE CLASS) ASK THIS WAY] 

For the credit class that you reported teaching at [FILL INSTNAME] during the 2002 Fall Term, please 
answer the following questions. 

(Please select the Help button for guidance on what types of classes are relevant.) 

* a. How many weeks did you teach the class? 

* b. How many credits were attached to the class? 
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Appendix B. Facsimile Instruments 



National Study of Postsecondary Faculty (NSOPF:04): Faculty Instrument Facsimile — Field Test 

* c. How many hours did you teach the class per week? 

* d. How many students were enrolled in the class? 

* e. What was the primary level of the students in this class? Were they undergraduate, 

graduate, or first professional (e.g., dental, medical, law, theology)? 

1 = Undergraduate 

2 = Graduate 

3 = First professional 

* f. Did you have a teaching or lab assistant, reader, or grader assigned to this class? 

0 = No 

1 = Yes 



Section: Institutional Responsibilities and Workload 



Form: 


Q38 






Name: 


Q38a 


Labei 


Student evaluations 


Name: 


Q38b 


Labei 


Multiple choice midterm/final exams 


Name: 


Q38c 


Labei 


Essay midterm/final exams 


Name: 


Q38d 


Labei 


Short answer midterm/final exams 


Name: 


Q38e 


Labei 


Term/research papers 


Name: 


Q38f 


Labei 


Multiple drafts of written work 


Name: 


Q38g 


Labei 


Oral presentations 


Name: 


Q38h 


Labei 


Group projects 


Name: 


Q38I 


Labei 


Laboratory/shop/studio assignments 


Name: 


Q38j 


Labei 


Service learn/co-op interact w/ business 



Form Administered To: 

Faculty who taught an undergraduate credit class 

Stem Wording: 

For the undergraduate classes you taught for credit during the 2002 Fall Term, did you use any of the 
following for student evaluation? 

Please specify whether it was used in all classes, some classes, or not used at all. 

Did you use... 

* Student evaluations of each other's work? 

* Multiple-choice midterm or final exam? 

* Essay midterm or final exam? 

* Short-answer midterm or final exam? 

* Term/research papers and writing assignments? 

* Multiple drafts of written work? 
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National Study of Postsecondary Faculty (NSOPF:04): Faculty Instrument Facsimile — Field Test 



* Oral presentations by students? 

* Group and team projects producing a joint product? 

* Laboratory, shop, or studio assignments? 

* Service learning, co-op experiences or assignments requiring 
interactions with the community or business/industry? 

1 = Used in all classes 

2 = Used in some classes 

3 = Not used 



Section: Institutional Responsibilities and Workload 

Form: Q39 Label: Web site for any classes 

Form Administered To: 

Faculty and instructional staff who had instructional duties and/or taught classes 

Stem Wording: 

During the 2002 Fall Term at [FILL INSTNAME], did you have one or more Internet web sites or network 
sites for instruction, materials exchange or other purposes for any of your teaching, advising, or other 
instructional duties? 



0 = No 

1 = Yes 



Section: 


Institutional Responsibilities and Workload 




Form: 


Q40 






Name: 


Q40a 


Labei: 


Web site to communicate with students 


Name: 


Q40b 


Labei: 


Web site to provide course content 


Name: 


Q40c 


Labei: 


Web site real time computer-based instr 


Name: 


Q40d 


Labei: 


Web site for class management 


Name: 


Q40e 


Labei: 


Web site to assess student performance 


Name: 


Q40f 


Labei: 


Web site for practice exams/assignments 


Name: 


Q40g 


Labei: 


Web site used for any other purpose 


Name: 


Q40gsp 


Labei: 


Web site used for other (specify) 



Form Administered To: 

Faculty and instructional staff who had instructional duties and/or taught classes, and who had a web site 
for instructional purposes 

Stem Wording: 

How did you use the web sites for your instructional activities? Did you use them... 

* To facilitate communication with and between students (e.g., with listservs, e-mail, online forums, 
instant messaging) 

* To provide content (e.g., syllabus, readings, resources, links) 
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Appendix B. Facsimile Instruments 



National Study of Postsecondary Faculty (NSOPF:04): Faculty Instrument Facsimile — Field Test 

* To provide direct computer-based instruction to students in "real time" (e.g., using Blackboard or other 
synchronous, interactive conferencing system) 

* For management purposes (e.g., registration, grade reporting, scheduling) 

* To assess performance (e.g., online quizzes) 

* To provide practice exams and assignments 

* For any other purpose not included above 

Please specify: 

0 = No 

1 = Yes 



Section: Institutional Responsibilities and Workload 

Form: Q41 Label: Hours per week e-mailing students 

Form Administered To: 

Faculty and instructional staff who had instructional duties and/or taught classes 

Stem Wording: 

During the 2002 Fall Term at [FILL INSTNAME], how many hours per week did you spend communicating 
by e-mail (electronic mail) with your students? (If none, enter "0.") 

* Hours per week: 



Section: Institutional Responsibilities and Workload 



Form: 


Q43 






Name: 


Q43a 


Label: 


Plan instruction/curriculum with faculty 


Name: 


Q43b 


Label: 


Provide career guidance to students 


Name: 


Q43c 


Label: 


Seek industry input for curriculum 


Name: 


Q43d 


Label: 


Network to get jobs for students 



Form Administered To: 

Faculty and instructional staff who had instructional duties and/or taught classes 
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National Study of Postsecondary Faculty (NSOPF:04): Faculty Instrument Facsimile — Field Test 

Stem Wording: 

For the next couple of questions, we would like you to consider the 2002 Calendar Year. During the 
2002 Calendar Year, how often did you engage in the following activities? Was it weekly, monthly, once 
per term/year, or never? 

* a. Met with other faculty to plan and coordinate instruction or curriculum 

* b. Talked with students about their career plans or provided career guidance to students seeking 

employment 

* c. Met with business or industry representatives to develop, improve, or revise curriculum 

* d. Called or met with business or industry representatives to develop employment opportunities for your 

students 

1 = Weekly 

2 = Monthly 

3 = Once per term/year 

4 = Never 



Section: Institutional Responsibilities and Workload 



Form: 


Q44 






Name: 


Q44a 


Label: 


Training: develop curriculum 


Name: 


Q44b 


Label: 


Training: new instructional practices 


Name: 


Q44c 


Label: 


Training: educational technology 


Name: 


Q44d 


Label: 


Training: stdnt perform to improve teach 


Name: 


Q44e 


Label: 


Training: student workplace skill needs 


Name: 


Q44f 


Label: 


Training: other 


Name: 


Q44fsp 


Label: 


Training: other specify 



Form Administered To: 

Faculty and instructional staff who had instructional duties and/or taught classes 

Stem Wording: 

During the 2002 Calendar Year, did you use training or professional development resources provided by 
your department or institution to... 

* Develop new or improved curriculum 

* Learn how to use new instructional practices 

* Learn how to better use educational technology 

* Learn how to use student performance data to improve curriculum or teaching 

* Keep up with skills and knowledge required of your students in the workplace 

* Other 
Please specify: 



0 = No 

1 = Yes 
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National Study of Postsecondary Faculty (NSOPF:04): Faculty Instrument Facsimile — Field Test 



Section: Institutional Responsibilities and Workload 

Form: Q45 Label: Hours professional training in 2002 

Form Administered To: 

Faculty and instructional staff who had instructional duties and/or taught classes, and who used 
departmental or institutional training/professional development resources 

Stem Wording: 

How many hours during the 2002 Calendar Year did you spend in training or professional development? 
* Hours of training or professional development: 



Section: Institutional Responsibilities and Workload 

Form: Q46 Label: Provide individual instruction fall 2002 

Form Administered To: 

All faculty and instructional staff 

Stem Wording: 

Now for the 2002 Fall Term, did you provide individual instruction to any student at [FILL INSTNAME]? 
By individual instruction, we mean independent study, supervising student teachers or interns, and one- 
on-one instruction like working with students on performance techniques or in a clinical or research 
setting. Do not include dissertation/thesis committee work. 



0 = No 

1 = Yes 



Section: 


Institutional Responsibilities and Workload 




Form: 


Q47 






Name: 


Q47al 


Labei: 


Individual instructn: undergrad students 


Name: 


Q47a2 


Labei: 


Individual instructn: graduate students 


Name: 


Q47a3 


Labei: 


Individual instructn: professnl students 



Form Administered To: 

Faculty and instructional staff who provided individual instruction to students 

Stem Wording: 

How many of the students you provided individual instruction to during the 2002 Fall Term at [FILL 
INSTNAME] were undergraduates? (If none, enter "0.") 

How many were graduate students? 

And how many were first-professional students (e.g., dental, medical, optometry, osteopathic, pharmacy, 
veterinary, chiropractic, law, and theology)? 

(Individual instruction includes: independent study, supervising student teachers or interns, and one-on- 
one instruction like working with individual students in a clinical or research setting.) 
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National Study of Postsecondary Faculty (NSOPF:04): Faculty Instrument Facsimile — Field Test 



Section: Institutional Responsibilities and Workload 



Form: 


Q47B 






Name: 


Q47bl 


Labei: 


Individual instruction: undergrad hours 


Name: 


Q47b2 


Labei: 


Individual instruction: graduate hours 


Name: 


Q47b3 


Labei: 


Individual instruction: professnal hours 



Form Administered To: 

Faculty and instructional staff who provided individual instruction to undergraduates or graduate students 
or first-professional students 

Stem Wording: 

Of the students who received individual instruction from you during the 2002 Fall Term, what was the 
totai number of contact hours you had each week with your... 

* Undergraduate students 

* Graduate students 

* First-professional students 

Section: Institutional Responsibilities and Workload 

Form: Q48 Labei: Hours per week undergrad/grad committees 

Form Administered To: 

All faculty and instructional staff 

Stem Wording: 

On average, during [FILL INSTNAMEJ's 2002 Fall Term, how many hours per week did you spend on 
undergraduate and graduate thesis or dissertation committees, comprehensive exams or orals committees, 
or examination or certification committees? (If none, enter "0." If less than one hour, enter "1.") 

* Hours per week spent on undergraduate and graduate committee work: 



Section: Institutional Responsibilities and Workload 

Form: Q49 Labei: Hours per week admin committee work 

Form Administered To: 

All faculty and instructional staff 

Stem Wording: 

How many hours per week did you spend on administrative committee work at [FILL INSTNAME] during the 
Fall Term? Please include curriculum, personnel, governance, and other committees at the department, 
division, institution, and system levels. (If none, enter "0." If less than one hour, enter "1.") 

* Hours per week spent on administrative committee work: 
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National Study of Postsecondary Faculty (NSOPF:04): Faculty Instrument Facsimile — Field Test 



Section: Institutional Responsibilities and Workload 

Form: Q50 Label: Contact hours per week with advisees 

Form Administered To: 

All faculty and instructional staff 

Stem Wording: 

On average, how many contact hours per week during the 2002 Fall Term did you spend with students 
you were assigned to advise? 

(Do not include hours spent working with students on their theses, dissertations, or independent studies. 
If none, enter "0." If less than one hour, enter "1.") 

* Number of contact hours per week spent with advisees: 



Section: Institutional Responsibilities and Workload 

Form: Q51 Label: Office hours per week 

Form Administered To: 

All faculty and instructional staff 

Stem Wording: 

During the 2002 Fall Term, how many regularly scheduled office hours (either in person or online) did you 
have per week? (If none, enter "0." If less than one hour, enter "1.") 

* Number of regularly scheduled office hours per week: 
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Appendix B. Facsimile Instruments 

National Study of Postsecondary Faculty (NSOPF:04): Faculty Instrument Facsimile — Field Test 

► BEGIN SECTION D: Scholarly Activities 

Section: Scholarly Activities 



Form: 


Q52A 






Name: 


Q52AA 


Label: 


Career articles, refereed journals 


Name: 


Q52AB 


Label: 


Career articles, nonrefereed journals 


Name: 


Q52AC 


Label: 


Career book reviews, chapters 


Name: 


Q52AD 


Label: 


Career books, textbooks, reports 


Name: 


Q52AE 


Label: 


Career presentations 


Name: 


Q52AF 


Label: 


Career exhibitions, performances 


Name: 


Q52AG 


Label: 


Career patents, computer software 


Name: 


Q52NO 


Label: 


No presentations/publications 



Form Administered To: 

All faculty and instructional staff 

Stem Wording: 

Next we would like to consider your scholarly activities. During your career... 

(For publications, please include only works that have been accepted for publication. Count multiple 
publications/presentations of the same work only once. Include electronic publications that are not 
published elsewhere in the appropriate categories.) 

* How many articles have you published in refereed professional or trade journals; or how many creative 
works have you published in juried media?" 

* Articles published in nonrefereed professional or trade journals; creative works published in nonjuried 
media or in-house newsletters 

* Published reviews of books, articles, or creative works; chapters in edited volumes 

* Textbooks, other books; monographs; research or technical reports disseminated internally or to clients 

* Presentations at conferences, workshops, etc. 

* Exhibitions or performances in the fine or applied arts 

* Other elements, such as patents or computer software products 

* No presentations or publications 



Section: Scholarly Activities 

Form: Q52aacat Label: Range career articles, refereed 

Form Administered To: 

Faculty and instructional staff who need assistance answering the number of refereed publications that 
they achieved over a lifetime 

Stem Wording: 

Your own rough or best estimate will be acceptable here. Or if you wish to select one of the following 
ranges, we will enter the midpoint of the range for you. (Use the Back key at the bottom of the screen if 
you wish to return to the previous screen to enter the number.) 

0 (No activities) 

I- 10 (5 will be entered) 

II- 20 (15 will be entered) 

21-40 (30 will be entered) 

41-60 (50 will be entered) 

61 or greater (61 will be entered) 
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Appendix B. Facsimile Instruments 



National Study of Postsecondary Faculty (NSOPF:04): Faculty Instrument Facsimile — Field Test 
Section: Scholarly Activities 

Form: Q52abcat Label: Range career articles, nonrefereed 

Form Administered To: 

Faculty and instructional staff who need assistance answering the number of nonrefereed publications that 
they achieved over a lifetime 

Stem Wording: 

Your own rough or best estimate will be acceptable here. Or if you wish to select one of the following 
ranges, we will enter the midpoint of the range for you. (Use the Back key at the bottom of the screen 
ifyou wish to return to the previous screen to enter the number.) 

0 (No activities) 

I- 10 (5 will be entered) 

II- 20 (15 will be entered) 

21-40 (30 will be entered) 

41-60 (50 will be entered) 

61 or greater (61 will be entered) 



Section: Scholarly Activities 

Form: Q52accat Label: Range book reviews, chapters 

Form Administered To: 

Faculty and instructional staff who need assistance answering the number of published reviews that they 
achieved over a lifetime 

Stem Wording: 

Your own rough or best estimate will be acceptable here. Or if you wish to select one of the following 
ranges, we will enter the midpoint of the range for you. (Use the Back key at the bottom of the screen if 
you wish to return to the previous screen to enter the number.) 

0 (No activities) 

I- 10 (5 will be entered) 

II- 20 (15 will be entered) 

21-40 (30 will be entered) 

41-60 (50 will be entered) 

61 or greater (61 will be entered) 
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National Study of Postsecondary Faculty (NSOPF:04): Faculty Instrument Facsimile — Field Test 
Section: Scholarly Activities 

Form: Q52adcat Label: Range career books, textbooks, reports 

Form Administered To: 

Faculty and instructional staff who need assistance answering the number of textbooks or reports that 
they achieved over a lifetime 

Stem Wording: 

Your own rough or best estimate will be acceptable here. Or if you wish to select one of the following 
ranges, we will enter the midpoint of the range for you. (Use the Back key at the bottom of the screen if 
you wish to return to the previous screen to enter the number.) 

0 (No activities) 

I- 10 (5 will be entered) 

II- 20 (15 will be entered) 

21-40 (30 will be entered) 

41-60 (50 will be entered) 

61 or greater (61 will be entered) 



Section: Scholarly Activities 

Form: Q52aecat Label: Range career presentations 

Form Administered To: 

Faculty and instructional staff who need assistance answering the number of presentations at conferences 
or workshops that they achieved over a lifetime 

Stem Wording: 

Your own rough or best estimate will be acceptable here. Or if you wish to select one of the following 
ranges, we will enter the midpoint of the range for you. (Use the Back key at the bottom of the screen if 
you wish to return to the previous screen to enter the number.) 

0 (No activities) 

I- 10 (5 will be entered) 

II- 20 (15 will be entered) 

21-40 (30 will be entered) 

41-60 (50 will be entered) 

61 or greater (61 will be entered) 
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Appendix B. Facsimile Instruments 



National Study of Postsecondary Faculty (NSOPF:04): Faculty Instrument Facsimile — Field Test 
Section: Scholarly Activities 

Form: Q52afcat Label: Range career exhibitions, performances 

Form Administered To: 

Faculty and instructional staff who need assistance answering the number of exhibitions or performances 
in the fine/applied arts that they achieved over a lifetime 

Stem Wording: 

Your own rough or best estimate will be acceptable here. Or if you wish to select one of the following 
ranges, we will enter the midpoint of the range for you. (Use the Back key at the bottom of the screen if 
you wish to return to the previous screen to enter the number.) 

0 (No activities) 

I- 10 (5 will be entered) 

II- 20 (15 will be entered) 

21-40 (30 will be entered) 

41-60 (50 will be entered) 

61 or greater (61 will be entered) 



Section: Scholarly Activities 

Form: Q52agcat Label: Range career patents, computer software 

Form Administered To: 

Faculty and instructional staff who need assistance answering the number of other scholarly activities such 
as patents or computer software products that they achieved over a lifetime 

Stem Wording: 

Your own rough or best estimate will be acceptable here. Or if you wish to select one of the following 
ranges, we will enter the midpoint of the range for you. (Use the Back key at the bottom of the screen if 
you wish to return to the previous screen to enter the number.) 

0 (No activities) 

I- 10 (5 will be entered) 

II- 20 (15 will be entered) 

21-40 (30 will be entered) 

41-60 (50 will be entered) 

61 or greater (61 will be entered) 
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National Study of Postsecondary Faculty (NSOPF:04): Faculty Instrument Facsimile — Field Test 
Section: Scholarly Activities 



Form: 


Q52B 






Name: 


Q52BA 


Label: 


Two years articles, refereed journals 


Name: 


Q52BB 


Label: 


Two years articles, nonrefereed journals 


Name: 


Q52BC 


Label: 


Two years book reviews, chapters 


Name: 


Q52BD 


Label: 


Two years books, textbooks, reports 


Name: 


Q52BE 


Label: 


Two years presentations 


Name: 


Q52BF 


Label: 


Two years exhibitions, performances 


Name: 


Q52BG 


Label: 


Two years patents, computer software 



Form Administered To: 

Faculty and instructional staff who have presented or published during their career. 

Stem Wording: 

We would like to consider the level of your scholarly activities during the last two years 

* Of the [FILL Q52AA] articles or creative works published in refereed journals or juried media in your 
career, how many were done in the last two years? 

* Of the [FILL Q52AB] articles or creative works published in nonrefereed journals or nonjuried media in 
your career, how many were done in the last two years? 

* Of the [FILL Q52AC] reviews of books, articles, or creative works, or chapters in edited volumes 
published in your career, how many were in the last two years? 

* Of the [FILL Q52AD] textbooks, other books, monographs, and client reports you published during your 
career, how many were done in the last two years? 

* Of the [FILL Q52AE] presentations you made at conferences or workshops in your career, how many 
were made in the last two years? 

* Of your [FILL Q52AF] career exhibitions or performances, how many were in the last two years? 

* Of your [FILL Q52AG] career patents, software products, or other works, how many were done in the 
last two years? 



Section: Scholarly Activities 

Form: Q53 Label: Teaching and research fields are same 

Form Administered To: 

Faculty and instructional staff who provided a principal teaching field 

Stem Wording: 

You noted before that your principal teaching field was [FILL Q16]. Is this also your principal field or 
discipline of scholarly activity? 

(By scholarly activity we mean research, proposal development, creative writing, or other creative works.) 

1 = Yes, fields of teaching and scholarly activity are the same 

2 = No, fields of teaching and scholarly activity are different 

3 = No, I have no principal scholarly activity field 
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Appendix B. Facsimile Instruments 



National Study of Postsecondary Faculty (NSOPF:04): Faculty Instrument Facsimile — Field Test 
Section: Scholarly Activities 

Form: Q54VS Label: Principal field of research-verbatim 

Name: Q54VS1 Label: Principal field of research-NA 

Form Administered To: 

Faculty and instructional staff who do not have a principal field of teaching or their teaching and scholarly 
activity fields are different 

Stem Wording: 

What is your principal field or discipline of scholarly activity? 

(Enter the name of the principal field or discipline in the box below. If you have no principal field, select 
the "Not applicable" box.) 

[IF Q16VS=NA OR BLANK, THEN ADD:] 

(By scholarly activity we mean research, proposal development, creative writing, or other creative works.) 

* Name of principal field/discipline of scholarly activity: 

* Not applicable (No principal field or discipline of scholarly activity) 



Section: Scholarly Activities 
Form: Q54CD 

Name: Q54CD2 Label: Principal field of research-CIP code 2 

Name: Q54CD4 Label: Principal field of research-CIP code 4 

Form Administered To: 

Faculty and instructional staff who do not have a principal field of teaching or their teaching and scholarly 
activity fields are different who have a principal field of scholarly activity. 

Stem Wording: 

Next, please help us to categorize "[FILL Q54VS]" using the drop-down list boxes below. (Select a general 
area and specific discipline within the general area.) 

* General area: 

* Specific area: 

Note: Please refer to the complete list of instructional program codes on form Q16CD. 



Section: Scholarly Activities 

Form: Q55 Labei: Funded or non-funded scholarly activity 

Form Administered To: 

All faculty and instructional staff unless they reported no principal scholarly activity field 

Stem Wording: 

During the 2002-03 academic year, were your scholarly activities at [FILL INSTNAME] funded, non- 
funded, or both funded and non-funded? 

0 = No scholarly activities 

1 = Funded activities only 

2 = Both funded and non-funded activities 

3 = Non-funded activities only 
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National Study of Postsecondary Faculty (NSOPF:04): Faculty Instrument Facsimile — Field Test 
Section: Scholarly Activities 

Form: Q56 Label: Description of primary research 

Form Administered To: 

Faculty and instructional staff who engage in scholarly activity 

Stem Wording: 

How would you describe your principal scholarly activity during the 2002-03 academic year? Was it... 

1 = Basic research 

2 = Applied or policy-oriented research or analysis 

3 = Literary, performance, or exhibitions 

4 = Program and curriculum design and development 

5 = Other 



Section: Scholarly Activities 

Form: Q58 Label: Primary funding source 

Form Administered To: 

Faculty and instructional staff who engage in funded scholarly activity 

Stem Wording: 

What was the principal source of funding for your scholarly activity during the 2002-03 academic year? 
Was it... 

1 = Your institution 

2 = Foundation or other nonprofit organization 

3 = For-profit business or industry in the private sector 

4 = State or local government 

5 = Federal government 

6 = Other 



Section: Scholarly Activities 

Form: Q59 Label: Number of grants/contracts 

Form Administered To: 

Faculty and instructional staff who engage in funded scholarly activity 



Stem Wording: 

How many grants/contracts did you have from all sources in the 2002-03 academic year? 
* Total number of grants/contracts: 

1 = 1 
2 = 2 

3 = 3 

4 = 4 

5 = 5 

6 = 6 

7 = 7 

8 = 8 
9 = 9 

10 = 10 
11 = 11 
12 = 12 

13 = 13 

14 = 14 

15 = 15 or more grants/contracts 
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Appendix B. Facsimile Instruments 



National Study of Postsecondary Faculty (NSOPF:04): Faculty Instrument Facsimile — Field Test 
Section: Scholarly Activities 

Form: Q60A Label: Total funding grants/contracts 

Form Administered To: 

Faculty and instructional staff who engage in funded scholarly activity 

Stem Wording: 

What was your total funding for grants and contracts from all sources for the 2002-03 academic year? 
*Total funding 
-1 = Don't know 



Section: Scholarly Activities 

Form: Q60B Label: Range total funding grants/contracts 

Form Administered To: 

Faculty and instructional staff who engage in funded scholarly activity who did not report the total funding 
amount received from grants/contracts during the 2002-03 academic year 

Stem Wording: 

The following ranges may make it easier for you to report the total funds you received for grants and 
contracts for the 2002-2003 academic year. Were your total funds received... 

-1 = Don't know 

1 = $l-$999 

2 = $l,000-$4,999 

3 = $5,000-$49,999 

4 = $50,000-$99,999 

5 = $100,000-$199,999 

6 = $200,000-$299,999 

7 = $300,000-$500,000 

8 = More than $500,000 
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National Study of Postsecondary Faculty (NSOPF:04): Faculty Instrument Facsimile — Field Test 

► BEGIN SECTION E: Job Satisfaction 

Section: Job Satisfaction 



Form: 


Q61 






Name: 


Q61a 


Labei: 


Satisfied w/authority to make decisions 


Name: 


Q61b 


Labei: 


Satisfied w/technology-based activities 


Name: 


Q61c 


Labei: 


Satisfied with equipment/facilities 


Name: 


Q61d 


Labei: 


Satisfied with teaching improvement 



Form Administered To: 

Faculty and instructional staff with instructional duties (including individual instruction and 
thesis/dissertation committee work as well as teaching classes) at target school during the 2002 Fall Term 

Stem Wording: 

How satisfied are you with each of the following aspects of your instructional duties at [FILL INSTNAME]? 
Would you say you are very dissatisfied, somewhat dissatisfied, somewhat satisfied, or very satisfied 
with... 

* a. The authority you have to make decisions about content and methods in your instructional activities 

* b. The training available to you to implement technology-based instructional activities 

* c. Quality of equipment and facilities available for classroom instruction 

* d. Institutional support for teaching improvement (including grants, release time, and professional 

development funds) 

1 = Very Dissatisfied 

2 = Somewhat Dissatisfied 

3 = Somewhat Satisfied 

4 = Very Satisfied 



Section 


: Job Satisfaction 






Form: 


Q62 






Name: 


Q62a 


Labei: 


Satisfied with work load 


Name: 


Q62b 


Labei: 


Satisfied with salary 


Name: 


Q62c 


Labei: 


Satisfied with benefits 


Name: 


Q62d 


Labei: 


Satisfied with job overall 



Form Administered To: 

All faculty and instructional staff 

Stem Wording: 

How satisfied are you with the following aspects of your job at [FILL INSTNAME]? Would you say you are 
very dissatisfied, somewhat dissatisfied, somewhat satisfied, or very satisfied with... 

* a. Your work load 

* b. Your salary 

* c. Your benefits, generally 

* d. Your job at this institution, overall 
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Appendix B. Facsimile Instruments 



National Study of Postsecondary Faculty (NSOPF:04): Faculty Instrument Facsimile — Field Test 

1 = Very Dissatisfied 

2 = Somewhat Dissatisfied 

3 = Somewhat Satisfied 

4 = Very Satisfied 



Section: Job Satisfaction 

Form: Q63 Label: Age stop working at PSE institution 

Form Administered To: 

All faculty and instructional staff 

Stem Wording: 

At what age do you think you are most likely to stop working at a postsecondary institution? (Enter age or 
select "Don't know.") 

* Years of age: 

-1 = Don't know 



Section: Job Satisfaction 

Form: Q64 Label: Retired from another position 

Form Administered To: 

All faculty and instructional staff 

Stem Wording: 

Have you retired from another position? 



0 = No 

1 = Yes 

Section: Job Satisfaction 

Form: Q65 Label: Age retire from all paid employment 

Form Administered To: 

All faculty and instructional staff 

Stem Wording: 

At what age do you think you are most likely to retire from all paid employment? (Enter age or select 
"Don't know.") 

* Years of age: 

-1 = Don't know 
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National Study of Postsecondary Faculty (NSOPF:04): Faculty Instrument Facsimile — Field Test 

^ BEGIN SECTION F: Compensation 

Section: Compensation 



Form: 


Q66 






Name: 


Q66aa 


Label: 


Basic salary from institution 


Name: 


Q66ab 


Label: 


Other income from institution 


Name: 


Q66ac 


Label: 


Other academic institution income 


Name: 


Q66ad 


Label: 


Consulting or freelance work income 


Name: 


Q66ae 


Label: 


Other employment income 


Name: 


Q66af 


Label: 


Other income 



Form Administered To: 

All faculty and instructional staff 

Stem Wording: 

We are almost finished. The next questions will be about your compensation as a faculty member and 
about your background. Your responses to these items are strictly confidential. They will be used only in 
statistical summaries. 

For the 2002 caiendar year, please estimate your gross compensation before taxes. Do not include 
non-monetary compensation. (Enter dollar amount. If not sure, give your best estimates. If not applicable, 
enter "0.") 

First, your compensation from [FILL INSTNAME]: 

a. What is your basic salary during the calendar year from this institution? * 

b. How much compensation did you receive from other income from this institution not included 
in basic salary (e.g., for summer session, overload courses, administration, 

research, coaching sports, etc.)? * 

Next, your compensation from other sources: 

c. How much were you paid for employment at another postsecondary institution? * 

d. How much were you paid for outside consulting or freelance work? * 

e. How much were you compensated for any other employment (besides consulting and 

another postsecondary institution)? * 

f. How much income did you receive from any other source (e.g., legal/medical/psychological services, 
self-owned business, professional performances/exhibitions, speaking fees/ 

honoraria, royalties/commissions, pensions, investment income, real estate, loans, alimony, 
or child support)? * 
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National Study of Postsecondary Faculty (NSOPF:04): Faculty Instrument Facsimile — Field Test 
Section: Compensation 

Form: Q66B Label: Total income 

Form Administered To: 

Respondents who did not complete all compensation item amounts. 

Stem Wording: 

If you are uncomfortable with providing your exact compensation from [INSTNAME] and other sources, 
would you please estimate your total income from all sources for the 2002 calendar year using the 
following ranges? 

(Your responses to these items are strictly confidential. They will be used only in statistical summaries.) 

* Because you left one or more items blank on the previous question about compensation, would you 
please estimate your total income from all sources for the 2002 calendar year using the following 
ranges? 

1 = $1-24,999 

2 = $25,000-49,999 

3 = $50,000-74,999 

4 = $75,000-99,999 

5 = $100,000-149,999 

6 = $150,000-199,000 

7 = $200,000-300,000 

8 = More than $300,000 



Section: Compensation 

Form: Q67 Label: Contract year length 

Form Administered To: 

All faculty and instructional staff 

Stem Wording: 

Is your basic salary at [FILL INSTNAME] this academic year based on a 9- or 10-month contract, an 11- or 
12-month contract, or some other arrangement? 

Please answer based on the length of your contract and how long you work rather than on the number of 
months you are paid. 

1 = 9- or 10-month contract 

2 = 11- or 12-month contract 

3 = Other 
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National Study of Postsecondary Faculty (NSOPF:04): Faculty Instrument Facsimile — Field Test 
Section: Compensation 

Form: Q68 Label: Pay basis 

Name: Q68SP Label: Pay basis other specify 

Form Administered To: 

Faculty paid on something other than a 9-, 10-, 11-, or 12-month contract 

Stem Wording: 

What was the basis of your pay? Was it by... 

1 = Course 

2 = Credit hour 

3 = Academic term 

4 = Other * Please specify unit: 



Section: Compensation 

Form: Q69 Label: Amount paid per Q68 unit 

Form Administered To: 

Faculty paid on something other than a 9-, 10-, 11-, or 12-month contract who reported the basis of their 
pay 

Stem Wording: 

How much were you paid per [FILL Q68]? 



Section: Compensation 

Form: Q70A Label: Total household income 

Form Administered To: 

All faculty and instructional staff 

Stem Wording: 

For the 2002 calendar year, what was your total household income before taxes? 

(By household income, we mean the total income received by all persons residing in the house during the 
2002 calendar year, excluding minors and full-time students. Please include income from other sources 
including self-employment, interest earnings, alimony or child support, insurance benefits, and pension 
payments.) 

* Enter amount: 

-1 = Don't know 
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National Study of Postsecondary Faculty (NSOPF:04): Faculty Instrument Facsimile — Field Test 



Section: Compensation 

Form: Q70B Label: Total household income categories 

Form Administered To: 

Faculty who did not provide their household income (didn't know, left blank) 

Stem Wording: 

The following ranges may make it easier for you to report your annual household income. Was your 
income between... 

-1 = Don't know 

1 = $0-$44,999 

2 = $45,000-$64,999 

3 = $65,000-$84,999 

4 = $85,000-$99,999 

5 = $100,000-$124,999 

6 = $125,000-$149,999 

7 = $150,000-$200,000 

8 = More than $200,000 
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Appendix B. Facsimile Instruments 

National Study of Postsecondary Faculty (NSOPF:04): Faculty Instrument Facsimile — Field Test 

^ BEGIN SECTION G: Sociodemographic Characteristics 

Section: Sociodemographic Characteristics 

Form: Q71 Label: Gender 

Form Administered To: 

All faculty and instructional staff 

Stem Wording: 

The last few questions ask you to describe yourself and your opinions about your job. Are you ... 

1 = Male 

2 = Female 



Section: Sociodemographic Characteristics 

Form: Q72 Label: Year of birth 

Form Administered To: 

All faculty and instructional staff 

Stem Wording: 

In what year were you born? 

* Enter year: 



Section: Sociodemographic Characteristics 

Form: Q73 Label: Ethnicity: Hispanic/Latino 

Form Administered To: 

All faculty and instructional staff 

Stem Wording: 

Are you Hispanic or Latino? 



0 = No 

1 = Yes 
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Appendix B. Facsimile Instruments 



National Study of Postsecondary Faculty (NSOPF:04): Faculty Instrument Facsimile — Field Test 



Section 


: Sociodemographic Characteristics 






Form: 


Q74 






Name: 


Q74a 


Labei: 


Race: American Indian/AK Native 


Name: 


Q74b 


Labei: 


Race: Asian 


Name: 


Q74c 


Labei: 


Race: Black/ African American 


Name: 


Q74d 


Labei: 


Race: Native Hawaiian/Pacific Islander 


Name: 


Q74e 


Labei: 


Race: White 



Form Administered To: 

All faculty and instructional staff 

Stem Wording: 

Please select one or more of the following choices to best describe your race. Are you... 
(Select all that apply.) 

* American Indian or Alaska Native 

* Asian 

* Black or African American 

* Native Hawaiian or Other Pacific Islander 

* White 



Section: Sociodemographic Characteristics 

Form: Q75 Labei: Disability 

Form Administered To: 

All faculty and instructional staff 

Stem Wording: 

Do you have a long-lasting condition that substantially limits one or more of your major life activities? 

(By this we mean do you have a physical, visual, auditory, mental, emotional, or other disabling condition 
that limits your ability to see, hear, or speak; to learn, remember, or concentrate; to dress, bathe, or get 
around the house, or to get to school or around campus.) 

0 = No 

1 = Yes 
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National Study of Postsecondary Faculty (NSOPF:04): Faculty Instrument Facsimile — Field Test 
Section: Sociodemographic Characteristics 



Form: 


Q76 






Name: 


Q76a 


Label: 


Disability: hearing impairment 


Name: 


Q76b 


Label: 


Disability: blind/visually impaired 


Name: 


Q76c 


Label: 


Disability: speech/language impairment 


Name: 


Q76d 


Label: 


Disability: mobility/orthopedic 


Name: 


Q76e 


Label: 


Disability: other 



Form Administered To: 

Faculty and instructional staff with a disability that substantially limits one or more major life activities 

Stem Wording: 

What type of condition limits your major life activities? (Select all that apply.) 

* Hearing impairment (i.e., deaf or hard of hearing) 

* Blind or visual impairment that cannot be corrected by wearing glasses, or legally blind 

* Speech or language impairment 

* Mobility/orthopedic impairment 

* Other (e.g., specific learning disability, attention deficit, mental illness, or emotional disturbance) 



Section: Sociodemographic Characteristics 

Form: Q77 Label: Marital status 2002 fall term 

Form Administered To: 

All faculty and instructional staff 

Stem Wording: 

What best describes your marital or household status in the 2002 Fall Term? Are you... 

1 = Single and never married 

2 = Married 

3 = Living with partner or significant other regardless of marital status 

4 = Separated, divorced, or widowed 
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National Study of Postsecondary Faculty (NSOPF:04): Faculty Instrument Facsimile — Field Test 
Section: Sociodemographic Characteristics 

Form: Q78 Label: Number of dependents 

Form Administered To: 

All faculty and instructional staff 

Stem Wording: 

How many dependents do you have? Do not include yourself. (A dependent is someone receiving at least 
half of his or her financial support from you.) 

* Number of dependents: 

0 = No dependents 

1 = 1 
2 = 2 

3 = 3 

4 = 4 

5 = 5 

6 = 6 

7 = 7 

8 = 8 

9 = 9 

10 = 10 or more dependents 



Section: Sociodemographic Characteristics 

Form: Q79 Label: Number of dependent children 

Form Administered To: 

Faculty and instructional staff with at least one dependent 

Stem Wording: 

How many of the dependents you mentioned are children? (A dependent child is 24 years old or younger 
for whom you provide at least half of his/her financial support.) 

* Number of dependent children: 

0 = None 

1 = 1 
2 = 2 

3 = 3 

4 = 4 

5 = 5 

6 = 6 

7 = 7 

8 = 8 

9 = 9 

10 = 10 or more dependents 
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Appendix B. Facsimile Instruments 



National Study of Postsecondary Faculty (NSOPF:04): Faculty Instrument Facsimile — Field Test 



Section: Sociodemographic Characteristics 

Form: Q80 Label: Born in United States 

Form Administered To: 

All faculty and instructional staff 

Stem Wording: 

Were you born in the United States? 



0 = No 

1 = Yes 



Section: Sociodemographic Characteristics 

Form: Q81 Label: United States citizenship status 

Form Administered To: 

All faculty and instructional staff 

Stem Wording: 

Are you a citizen of the United States? 

0 = No 

1 = Yes 



NSOPF:04 Field Test Methodology Report 



182 








Appendix B. Facsimile Instruments 



National Study of Postsecondary Faculty (NSOPF:04): Faculty Instrument Facsimile — Field Test 

► BEGIN SECTION H: Opinions 

Section: Opinions 



Form: 


Q82 






Name: 


Q82a 


Labei: 


Opinion, teaching is rewarded 


Name: 


Q82b 


Labei: 


Opinion, part-time faculty treated fair 


Name: 


Q82c 


Labei: 


Opinion, female faculty treated fair 


Name: 


Q82d 


Labei: 


Opinion, racial minorities treated fair 



Form Administered To: 

All faculty and instructional staff 

Stem Wording: 

Do you strongly disagree, disagree, agree, or strongly agree that at [FILL INSTNAME]... 

* a. Good teaching is rewarded 

* b. Part-time faculty are treated fairly 

* c. Female faculty members are treated fairly 

* d. Faculty who are members of racial or ethnic minorities are treated fairly 

1 = Strongly Disagree 

2 = Disagree 

3 = Agree 

4 = Strongly Agree 



Section: Opinions 

Form: Q83 Labei: Choose to do academic career again 

Form Administered To: 

All faculty and instructional staff 

Stem Wording: 

Finally, if you had it to do over again, would you still choose an academic career? 

0 = No 

1 = Yes 



Section: Opinions 

Form: Q84X Labei: 

Form Administered To: 

Those who indicated they are not faculty and have no instructional duties 

Stem Wording: 

This interview is designed for faculty and instructional staff. Since you have indicated that you are neither, 
the interview will now terminate. Thank you very much for your interest in the study. 

Section: Opinions 

Form: Q84 Labei: Comments and suggestions 

Form Administered To: 

All faculty and instructional staff 

Stem Wording: 

As you know, this is a field test version of the faculty questionnaire. Do you have any comments, 
suggestions, or concerns about this data collection? 
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Appendix C 
Item Crosswalks 

(NSOPF:88, NSOPF:93, NSOPF:99, NSOPF:04) 

Institution 187 

Faculty 191 
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Appendix C. Item Crosswalks (NSOPF:88, NSOPF:93, NSOPF:99, NSOPF:04) 



Institution Questionnaire Crosswalk 

The crosswalk below links the NSOPF:04 field test questionnaire items with similar items from the three 
previous NSOPF institution questionnaires: NSOPF:99, NSOPF:93, and NSOPF:88. This crosswalk will 
facilitate analyses of trends among postsecondary institutions. Linked questions may be identical in 
content and format or may differ in one or more ways. The question, item, or response wording; the order 
in which response options were presented; the manner in which the data were collected (e.g., categorical 
response option versus open-ended response fields, instructions to mark one versus all that apply); and the 
population to which the question applies may have changed. It is strongly recommended that analysts 
review documentation to determine whether linked questions are equitable for their purpose. 



Variable names 



NSOPF:04 


NSOPF:99 


NSOPF:93 


NSOPF:88 


Variable label 


lA 


la 


la 


4 


Number full-time faculty, fall 2002 


IB 


lb 


lb 


19 


Number part-time faculty, fall 2002 


2A 


5aD 


2f 




Full-time numbers: faculty, fall 2001 


2B 


5bD 






Full-time numbers: changed from part to full time, 2001-02 


2C 


5cD 


2b 


6 


Full-time numbers: hired, 2001-02 


2D 


5dD 


2c 


6 


Full-time numbers: retired, 2001-02 


2E 


5e 


2e + 2d 


6 


Full-time numbers: left for other reasons, 2001-02 


2F 








Full-time numbers: changed from full to part time, 2001-02 


2G 


5f 


2a 


6 


Full-time numbers: faculty, fall 2002 


2AA 


5g 






Full-time numbers: inconsistent count reason 


3 


4 


5 


3 


Full-time tenure: has tenure system 


4 


6a 


8a 


7 


Full-time tenure: number considered for tenure, 2001-02 


5 


6b 


8b 


7 


Full-time tenure: number granted tenure, 2001-02 


6 


7a 


9a 


10 


Full-time tenure: maximum years on tenure track 


7A 


8a 






Full-time tenure: changed tenure policy 


7B 


8b 


10b 


12.5 


Full-time tenure: more stringent tenure standards 


1C 


8c 






Full-time tenure: downsized tenured faculty 


7D 


8d 


10a 


12.4 


Full-time tenure: replaced tenured with fixed term 


7E 


8f 


11 


12.1 


Full-time tenure: offered early retirement 


7E2 


8g 


11a 




Full-time tenure: number early retirees, last 5 yrs 


8 


8e 






Full-time tenure: discontinued tenure system, last 5 years 


9 


10 


3 




Full-time faculty: positions sought to fill, fall 2002 


lOAA 


12e 


13h 




Full-time benefit: child care 


lOAB 


12f 


13n 




Full-time benefit: retiree medical insurance 


10 AC 


12g 


13o 


16 


Full-time benefit: cafeteria-style plan 


lOBA 


12ea 


13hA 


14.10 


Full-time benefit: child care subsidized 


lOBB 


12fa 


13nA 




Full-time benefit: retiree medical insurance subsidized 


lOBC 


12ga 


13oA 




Full-time benefit: cafeteria-style plan subsidized 


llA 


13a 


13a 


14.01 


Full-time benefit: wellness program 


IIB 


13b 


13f 


14.08 


Full-time benefit: spouse tuition remission 


lie 


13c 


13g 


14.09 


Full-time benefit: children tuition remission 


IID 


13d 


131 


14.11 


Full-time benefit: housing 


HE 


13e 


13k 




Full-time benefit: transportation/parking 


IIF 


13f 


131 


14.02 


Full-time benefit: paid maternity leave 


IIG 


13g 


13m 


14.03 


Full-time benefit: paid paternity leave 


IIH 


13h 






Full-time benefit: paid sabbatical leave 


111 


131 






Full-time benefit: employee assistance program 


12 


15 


19 


13 


Full-time faculty: union representation 


13A 


16a 


18a 




Full-time assessment: student evaluations 


13B 


16b 


18b 




Full-time assessment: student test scores 
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Variable names 



NSOPF:04 


NSOPF:99 


NSOPF:93 


NSOPF:88 


Variable label 


13C 


16c 


18c 




Full-time assessment: student career placement 


13D 


16d 


18d 




Full-time assessment: other student performance 


13E 


16e 


18e 




Full-time assessment: department chair evaluations 


13F 


16f 


18f 




Full-time assessment: dean evaluations 


13G 


16g 


18g 




Full-time assessment: peer evaluations 


13H 


16h 


18h 




Full-time assessment: self-evaluations 


14 


17 


34 


23 


Part-time benefit: retirement plan 


15AA 


20a 


37b 




Part-time benefit: medical insurance 


15AB 


20b 


37c 




Part-time benefit: dental insurance 


15AC 


20c 


37d 




Part-time benefit: disability insurance 


15AD 


20d 


37e 




Part-time benefit: life insurance 


15AE 


20e 


37h 




Part-time benefit: child care 


15AF 


20f 


37n 




Part-time benefit: retiree medical insurance 


15 AG 


20g 


37o 


24 


Part-time benefit: cafeteria-style plan 


15BA 


20aa 


3 7b A 




Part-time benefit: medical insurance subsidized 


15BB 


20ba 


3 7c A 




Part-time benefit: dental insurance subsidized 


15BC 


20ca 


37dA 




Part-time benefit: disability insurance subsidized 


15BD 


20da 


37eA 




Part-time benefit: life insurance subsidized 


15BE 


20ea 


37hA 




Part-time benefit: child care subsidized 


15BF 


20fa 


37nA 




Part-time benefit: retiree medical insurance subsidized 


15BG 


20ga 


37oA 




Part-time benefit: cafeteria-style plan subsidized 


16A 


21a 


37a 




Part-time benefit: wellness program 


16B 


21b 


37f 




Part-time benefit: spouse tuition remission 


16C 


21c 


37g 




Part-time benefit: children tuition remission 


16D 


21d 


37i 




Part-time benefit: housing 


16E 


21e 


37k 




Part-time benefit: transportation/parking 


16F 


21f 


371 




Part-time benefit: paid maternity leave 


16G 


21g 


37m 




Part-time benefit: paid paternity leave 


16H 


21h 






Part-time benefit: paid sabbatical leave 


161 


21i 






Part-time benefit: employee assistance program 


17 


24 


43 


22 


Part-time faculty: union representation 


18A 


25a 


42a 




Part-time assessment: student evaluations 


18B 


25b 


42b 




Part-time assessment: student test scores 


18C 


25c 


42c 




Part-time assessment: student career placement 


18D 


25d 


42d 




Part-time assessment: other student performance 


18E 


25e 


42e 




Part-time assessment: department chair evaluations 


18F 


25f 


42f 




Part-time assessment: dean evaluations 


18G 


25g 


42g 




Part-time assessment: peer evaluations 


18H 


25h 


42h 




Part-time assessment: self-evaluations 


19A 


26a 


17 




Undergraduate instruction: percent full-time faculty 


19B 


26b 


41 




Undergraduate instruction: percent part-time faculty 


19C 


26c 






Undergraduate instruction: percent teaching assistants 


19D 


26d 






Undergraduate instruction: percent other 


NOTE: The name of each NSOPF:04 institution variable has an “I” as the starting character. 

SOURCE: U.S. Department of Education, National Center for Education Statistics, 2004 National Study of 



Postsecondary Faculty (NSOPF:04) field test, 1999 National Study of Postsecondary Faculty (NSOPF:99), 1993 
National Study of Postsecondary Faculty (NSOPF:93), 1988 National Survey of Postsecondary Faculty 
(NSOPF:88). 
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Appendix C. Item Crosswalks (NSOPF:88, NSOPF:93, NSOPF:99, NSOPF:04) 



Faculty Questionnaire Crosswalk 

The crosswalk below links the NSOPF:04 field test questionnaire items with similar items from the three 
previous NSOPF faculty questionnaires: NSOPF:99, NSOPF:93, and NSOPF:88. This crosswalk will 
facilitate analyses of trends among faculty at postsecondary institutions. Linked questions may be 
identical in content and format or may differ in one or more ways. The question, item, or response 
wording; the order in which response options were presented; the manner in which the data were collected 
(e.g., categorical response option versus open-ended response fields, instructions to mark one versus all 
that apply); and the population to which the question applies may have changed. It is strongly 
recommended that analysts review documentation to determine whether linked questions are equitable for 
their purpose. 



Variable name 



NSOPF:04 


NSOPF:99 


NSOPF:93 


NSOPF:88 


Variable label 


Qi 


Qi 


QI 


QI 


Instructional duties, fall 2002 


Q2 


Q2 


QIA 


Q2 


Instructional duties related to credit courses/activities, fall 2002 


Q3 


Q4 


Q3 




Faculty status, fall 2002 


Q4 


Q3 


Q2 




Principal activity, fall 2002 


Q5 


Q5 


Q4 


Q4 


Employed full or part time, fall 2002 


Q6 








Part-time faculty: primary employment 


Q7 








Part-time faculty: years employed part time 


Q8 








Part-time faculty: preferred full-time position 


Q9 


Q7 


Q6 




Year started job held in fall 2002 


QIO 


Q8 


Q9 


Q12 


Academic rank, fall 2002 


Qll 


Q9 


QIO 


Q13 


Year attained professor or associate professor rank at any institution 


Q12 


QIO 


Q7 


Q9 


Tenure status, fall 2002 


Q13 


QlOb 


Q7A 


QIO 


Year attained tenure at any postsecondary institution 


Q14 


Q64 


Q38 


Q18 


Faculty union membership 


Q15 


Q64 


Q38 




Reason why not a union member 


Q16VS 


Q14 


Q12 




Principal field of teaching-verbatim 


Q16CD4 


Q14 


Q12 


Q16 


Principal field of teaching-CIP code 


Q17A1 


Q16.1A 


Q16.1A 


Q26 


Highest degree type 


Q17A2 


Q16.1B 


Q16.1B 


Q26 


Year received highest degree 


Q17A3VS 


Q16.1C 


Q16.1D 




Highest degree field-verbatim 


Q17A3C4 


Q16.1D 


Q16.1C 


Q26 


Highest degree field-CIP code 


Q17A4ST 


Qie.lEb 


Qie.lEb 


Q26 


Highest degree institution-state 


Q17A4C 


Qie.lEb 


Qie.lEb 


Q26 


Highest degree institution-city 


Q17A4N 


Qie.lEa 


Qie.lEa 


Q26 


Highest degree institution-name 


Q17A4I 








Highest degree institution-IPEDS 


Q17A4LEV 








Highest degree institution-level 


Q17A4CN 








Highest degree institution-control 


Q17B 


Q16 


Q16 


Q26 


Hold PhD in addition to professional degree 


Q17C1 


Q16 


Q16 


Q26 


Year received doctoral degree 


Q17C2VS 


Q16 


Q16 




Doctoral degree field-verbatim 


Q17C2C4 


Q16 


Q16 


Q26 


Doctoral degree field-CIP code 


Q17C3ST 


Q16 


Q16 


Q26 


Doctoral degree institution-state 


Q17C3C 


Q16 


Q16 


Q26 


Doctoral degree institution-city 


Q17C3N 


Q16 


Q16 


Q26 


Doctoral degree institution-name 


Q17C3I 








Doctoral degree institution-IPEDS 


Q17C3LV 








Doctoral degree institution-level 


Q17C3CN 








Doctoral degree institution-control 


Q17D1 


Q16 


Q16 


Q26 


Year received bachelor’s degree 


Q17D2ST 


Q16 


Q16 


Q26 


Bachelor’s degree institution-state 


Q17D2C 


Q16 


Q16 


Q26 


Bachelor’s degree institution-city 
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Variable name 



NSOPF:04 


NSOPF:99 


NSOPF:93 


NSOPF:88 


Variable label 


Q17D2N 


Q16 


Q16 


Q26 


Bachelor’s degree institution-name 


Q17D2I 








Bachelor’s degree institution-IPEDS 


Q17D2LV 








Bachelor’s degree institution-level 


Q17D2CN 








Bachelor’s degree institution-control 


Q18 


Q21 


Q17 


Q5 


Employed outside target institution 


Q19A1 


Q22 


Q17A 


Q6 


Number full-time positions outside PSE 


Q19A2 


Q22 


Q17A 


Q6 


Number part-time positions outside PSE 


Q19B1 


Q22 


Q17A 


Q6 


Number full-time positions at other PSE 


Q19B2 


Q22 


Q17A 


Q6 


Number part-time positions at other PSE 


Q19C1 








Number classes taught full time at other PSE 


Q19C2 








Number classes taught part time at other PSE 


Q20 








Non-PSE jobs related to teaching field 


Q21 








First post-degree PSE faculty position 


Q22 


Q23 






Number of PSE institutions where employed as faculty 


Q23 


Q24.1a 




Q29 


First faculty position: year began 


Q24 


Q24.3a 




Q29 


First faculty position: part or full time 


Q25 


Q24.5a 






First faculty position: academic rank 


Q26 


Q24.6a 






First faculty position: tenure status 


Q27 


Q26 




Q29 


Held positions outside PSE since degree 


Q28 


Q28.2b 


Q19.2 


Q29 


Employment sector of previous job 


Q29 








Previous job related to teaching field 


Q30 


Q25 






Number years teaching in PSE institutions 


Q31A 


Q30a 


Q36a 


Q36 


Hours per week: paid tasks at institution 


Q31B 


Q30b 


Q36b 


Q36 


Hours per week: unpaid tasks at institution 


Q31C 


Q30c 


Q36c 


Q36 


Hours per week: paid tasks outside of institution 


Q31D 


Q30d 


Q36d 


Q36 


Hours per week: unpaid tasks outside of institution 


Q32A 


Q31aA + 
031bA 


Q37a 


Q37 


Percent time: instructional activities 


Q32B 


Q31cA 


Q37b 


Q37 


Percent time: research activities 


Q32C 






Q37 


Percent time: other activities 


Q33A 


Q31aA 






Percent instructional time: undergraduate 


Q33B 


Q31bA 






Percent instructional time: graduate/ 1st professional 


Q34A 


Q31eA 


Q37d 


Q37 


Percent other time: administration 


Q34B 


Q31dA 


Q37c 


Q37 


Percent other time: professional growth 


Q34C 


Q31fA 


Q37f 


Q37 


Percent other time: service 


Q34D 


Q31gA 


Q37f 


Q37 


Percent other time: other activities 


Q34DSP 






Q37 


Percent other time: other activities (specify) 


Q35A1 


Q40 


Q22A 




Number credit classes taught 


Q35A2 








Number noncredit classes taught 


Q35B1 


Q35 






Number remedial credit classes taught 


Q35B2 


Q36 






Number remedial noncredit classes taught 


Q35C1 


Q37 






Number distance education credit classes taught 


Q35C2 


Q38 






Number distance education noncredit classes taught 


Q36 








Have teaching assistant for any credit class 


Q37A1 


Q41.2Aa 


Q23.2Aa 




Number of weeks taught, 1st credit class 


Q37B1 


Q41.2Ab 


Q23.2Ab 




Number of credit hours, 1st class 


Q37C1 


Q41.2AC 


Q23.2AC 


Q32 


Number of hours taught per week, 1st class 


Q37D1 


Q41.2Ae 


Q23.2Ae 


Q32 


Number of students, 1st class 


Q37E1 


Q41.3A 


Q23.3A 


Q32 


Level of students, 1st class 


Q37F1 


Q41.2Ad 


Q23.2Ad 


Q32 


Teaching assistant, 1st class 


Q37A2 


Q41.2Ba 


Q23.2Ba 




Number of weeks taught, 2nd credit class 



NSOPF:04 Field Test Methodology Report 



194 






Appendix C. Item Crosswalks (NSOPF:88, NSOPF:93, NSOPF:99, NSOPF:04) 



Variable name 



NSOPF:04 


NSOPF:99 


NSOPF:93 


NSOPF:88 


Variable label 


Q37B2 


Q41.2Bb 


Q23.2Bb 




Number of credit hours, 2nd class 


Q37C2 


Q41.2BC 


Q23.2BC 


Q32 


Number of hours taught per week, 2nd class 


Q37D2 


Q41.2Be 


Q23.2Be 


Q32 


Number of students, 2nd class 


Q37E2 


Q41.3B 


Q23.3B 


Q32 


Level of students, 2nd class 


Q37F2 


Q41.2Bd 


Q23.2Bd 


Q32 


Teaching assistant, 2nd class 


Q37A3 


Q41.2Va 


Q23.2Ca 




Number of weeks taught, 3rd credit class 


Q37B3 


Q41.2Cb 


Q23.2Cb 




Number of credit hours, 3rd class 


Q37C3 


Q41.2CC 


Q23.2CC 


Q32 


Number of hours taught per week, 3rd class 


Q37D3 


Q41.2Ce 


Q23.2Ce 


Q32 


Number of students, 3rd class 


Q37E3 


Q41.3C 


Q23.3C 


Q32 


Level of students, 3rd class 


Q37F3 


Q41.2Cd 


Q23.2Cd 


Q32 


Teaching assistant, 3rd class 


Q37A4 


Q41.2Da 


Q23.2Da 




Number of weeks taught, 4th credit class 


Q37B4 


Q41.2Db 


Q23.2Db 




Number of credit hours, 4th class 


Q37C4 


Q41.2DC 


Q23.2DC 


Q32 


Number of hours taught per week, 4th class 


Q37D4 


Q41.2De 


Q23.2De 


Q32 


Number of students, 4th class 


Q37E4 


Q41.3D 


Q23.3D 


Q32 


Level of students, 4th class 


Q37F4 


Q41.2Dd 


Q23.2Dd 


Q32 


Teaching assistant, 4th class 


Q37A5 


Q41.2Ea 


Q23.2Ea 




Number of weeks taught, 5th credit class 


Q37B5 


Q41.2Eb 


Q23.2Eb 




Number of credit hours, 5th class 


Q37C5 


Q41.2EC 


Q23.2EC 


Q32 


Number of hours taught per week, 5th class 


Q37D5 


Q41.2Ee 


Q23.2Ee 


Q32 


Number of students, 5th class 


Q37E5 


Q41.3E 


Q23.3E 


Q32 


Level of students, 5th class 


Q37F5 


Q41.2Ed 


Q23.2Ed 


Q32 


Teaching assistant, 5th class 


Q37A6 








Number of weeks taught, 6th credit class 


Q37B6 








Number of credit hours, 6th class 


Q37C6 








Number of hours taught per week, 6th class 


Q37D6 








Number of students, 6th class 


Q37E6 








Level of students, 6th class 


Q37F6 








Teaching assistant, 6th class 


Q37A7 








Number of weeks taught, 7th credit class 


Q37B7 








Number of credit hours, 7th class 


Q37C7 








Number of hours taught per week, 7th class 


Q37D7 








Number of students, 7th class 


Q37E7 








Level of students, 7th class 


Q37F7 








Teaching assistant, 7th class 


Q37A8 








Number of weeks taught, 8th credit class 


Q37B8 








Number of credit hours, 8th class 


Q37C8 








Number of hours taught per week, 8th class 


Q37D8 








Number of students, 8th class 


Q37E8 








Level of students, 8th class 


Q37F8 








Teaching assistant, 8th class 


Q38A 


Q42a 


Q24Ad 




Student evaluations of each other's work 


Q38B 


Q42b 


Q24Ae 




Multiple choice midterm/final exams 


Q38C 


Q42c 


Q24Af 




Essay midterm/final exams 


Q38D 


Q42d 


Q24Ag 




Short answer midterm/final exams 


Q38E 


Q42e 


Q24Ah 




Term/research papers 


Q38F 


Q42f 


Q24Ai 




Multiple drafts of written work 


Q38G 




Q24Ac 




Oral presentations 


Q38H 








Group projects 


Q38I 








Laboratory/shop/studio assignments 



195 



NSOPF:04 Field Test Methodology Report 






Appendix C. Item Crosswalks (NSOPF:88, NSOPF:93, NSOPF:99, NSOPF:04) 



Variable name 



NSOPF:04 


NSOPF:99 


NSOPF:93 


NSOPF:88 


Variable label 


Q38J 








Service learning/co-op interactions w/business 


Q39 


Q43 






Web site used for any instructional duties 


Q40A 








Web site used to communicate with students 




Q44a + 










Q44b + 








Q40B 


Q44e 






Web site used to provide course content 


Q40C 








Web site used for real time computer-based instruction 


Q40D 


Q44d 






Web site used for class management 


Q40E 








Web site used to assess student performance 


Q40F 


Q44c 






Web site used for practice exams/assignments 


Q40G 


Q44f 






Web site used for any other purpose 


Q40GSP 


Q44f 






Web site used for other purpose (specify) 


Q41 


Q47 






Hours per week e-mailing students 


Q43A 








Activities for 2002: met to plan instruction/curriculum 


Q43B 








Activities for 2002: provide career guidance to students 


Q43C 








Activities for 2002: seek industry input for curriculum 


Q43D 








Activities for 2002: networked to get jobs for students 


Q44A 








Used training: develop curriculum 


Q44B 








Used training: learn new instructional practices 


Q44C 








Used training: learn educational technology 


Q44D 








Used training: learn to use student performance data 


Q44E 








Used training: keep up with student skills needed in workplace 


Q44F 








Used training: other 


Q44FSP 








Used training: other (specify) 


Q45 








Professional training hours, calendar year 2002 


Q46 








Provided individual instruction, fall 2002 






Q25.1A + 






Q47A1 


Q49a 


Q25.2A 


Q33 


Individual instruction: number undergraduate students 


Q47A2 


Q49b 


Q25.3A 


Q33 


Individual instruction: number graduate students 


Q47A3 


Q49c 






Individual instruction: number first-professional students 






Q25.1B + 






Q47B1 


Q49a 


Q25.2B 


Q33 


Individual instruction: undergraduate hours 


Q47B2 


Q49b 


Q25.3B 


Q33 


Individual instruction: graduate hours 


Q47B3 


Q49c 






Individual instruction: first-professional hours 


Q48 


Q32 






Hours per week undergraduate/graduate committees 


Q49 


Q63 






Hours per week administrative committees 


Q50 


Q50 






Hours per week with advisees 


Q51 


Q51 


Q26 




Office hours per week 






Q20.1A + 






Q52AA 


Q29.1 


Q20.3A 


Q30 


Career articles, refereed journals 






Q20.2A + 






Q52AB 


Q29.2 


Q20.4A 


Q30 


Career articles, nonrefereed journals 






Q20.5A + 






Q52AC 


Q29.3 


Q20.6A 


Q30 


Career book reviews, chapters, creative works 






Q20.8A + 










Q20.7A + 










Q20.9A+ 






Q52AD 


Q29.4 


Q20.10A 


Q30 


Career books, textbooks, reports 


Q52AE 


Q29.5 


Q20.11A 


Q30 


Career presentations 


Q52AF 


Q29.5 


Q20.12A 


Q30 


Career exhibitions, performances 






Q20.13A + 






Q52AG 


Q29.6 


Q20.14A 


Q30 


Career other, e.g., patents, computer software 






Q20.1B + 






Q52BA 


Q29.1 


Q20.3B 


Q30 


Last two years articles, refereed journals 
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Variable name 



NSOPF:04 


NSOPF:99 


NSOPF:93 


NSOPF:88 


Variable label 






Q20.2B + 






Q52BB 


Q29.2 


Q20.4B 


Q30 


Last two years articles, nonrefereed journals 






Q20.5B + 






Q52BC 


Q29.3 


Q20.6B 


Q30 


Last two years book reviews, chapters, creative works 






Q20.8B + 










Q20.7B + 










Q20.9B + 






Q52BD 


Q29.4 


Q20.10B 


Q30 


Last two years books, textbooks, reports 


Q52BE 


Q29.5 


Q20.11B 


Q30 


Last two years presentations 


Q52BF 


Q29.5 


Q20.12B 


Q30 


Last two years exhibitions, performances 






Q20.13B + 






Q52BG 


Q29.6 


Q20.14B 


Q30 


Last two years other, e.g., patents, computer software 


Q53 








Teaching and scholarly activity fields are same 


Q54VS 


Q15 


Q13 




Principal field of scholarly activity-verbatim 


Q54CD4 


Q15 


Q13 




Principal field of scholarly activity-CIP code 


Q55 


Q52 + Q54 


Q30 




Scholarly activity: funded 


Q56 


Q53 


Q29 




Principal scholarly activity: description 


Q58 


Q57 


Q33A 




Scholarly activity: principal funding source 


Q59 


Q58 


Q33B 




Scholarly activity: number grants/contracts 


Q60A 


Q59a 


Q33D 




Scholarly activity: grants/contracts funding amount 


Q60B 








Scholarly activity: grants/contracts funding amount (range) 


Q61A 


Q65a 


Q39a 


Q19 


Satisfaction: authority to make decisions 


Q61B 








Satisfaction: technology-based activities 


Q61C 








Satisfaction: equipment/facilities 


Q61D 








Satisfaction: institutional support for teaching improvement 


Q62A 


Q66a 


Q40a 


Q19 


Satisfaction: work load 


Q62B 


Q66g 


Q40f 


Q19 


Satisfaction: salary 


Q62C 


Q66h 


Q40g 


Q19 


Satisfaction: benefits 


Q62D 


Q66j 


Q40i 


Q19 


Satisfaction: job overall 


Q63 


Q68 


Q42 


Q24 


Age retire from PSE employment 


Q64 


Q72 






Retired from another position 


Q65 


Q74 


Q46 


Q25 


Age retire from all paid employment 


Q66AA 


Q76a 


Q47a 


Q40 


Income: basic salary from institution 






Q47c + 










Q47d + 






Q66AB 


Q76b 


Q47f 


Q40 


Income: other income from institution 


Q66AC 


Q76d 


Q47g 


Q40 


Income: other academic institution 


Q66AD 


Q76g 


Q47i 


Q40 


Income: consulting or freelance work 


Q66AE 


Q76e 


Q47n 


Q40 


Income: other employment 




Q76f + 


Q47h + 








Q76h + 


Q47j + 








Q76i + 


Q47k + 








Q76j + 


Q471 + 








Q76k + 


Q47m + 








Q76m + 


Q47p + 






Q66AF 


Q76n 


Q47q 


Q40 


Income: other sources 


Q66B 








Total income (range) 


Q67 


Q75b 






Contract year length 


Q68 


Q75b 






Pay basis 


Q68SP 


Q75b 






Pay basis (specify) 


Q69 








Amount paid per course/credit unit/term/other 


Q70A 


Q79 


Q49 




Income: total household 
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Variable name 



NSOPF:04 


NSOPF:99 


NSOPF:93 


NSOPF:88 


Variable label 


Q70B 








Income: total household (range) 


Q71 


Q81 


Q51 


Q41 


Gender 


Q72 


Q82 


Q52 


Q42 


Year of birth 


Q73 


Q83 


Q54 


Q43 


Ethnicity: Hispanic/Latino 


Q74A 


Q84 


Q53_l 


Q44 


Race: American Indian/ Alaska Native 


Q74B 


Q84 


Q53_2 


Q44 


Race: Asian 


Q74C 


Q84 


Q53_3 


Q44 


Race: Black/ African American 


Q74D 


Q84 


Q53_2 


Q44 


Race: Native Hawaiian/Pacific Islander 


Q74E 


Q84 


Q53_4 


Q44 


Race: White 


Q75 


Q85 






Disability 


Q76A 


Q86 






Disability type: hearing impairment 


Q76B 


Q86 






Disability type: visual impairment 


Q76C 


Q86 






Disability type: speech/language impairment 


Q76D 


Q86 






Disability type: mobility/orthopedic impairment 


Q76E 


Q86 






Disability type: other 


Q77 


Q87 


Q55 


Q45 


Marital status, fall 2002 


Q78 


Q80 


Q50 




Number of dependents 


Q79 








Number of dependent children 


Q80 


Q89 


Q56 




Born in United States 


Q81 


Q90 


Q57 


Q46 


United States citizenship status 


Q82A 








Opinion: teaching is rewarded 


Q82B 








Opinion: part-time faculty treated fair 


Q82C 


Q92f 


Q59e 




Opinion: female faculty treated fair 


Q82D 


Q92g 


Q59f 




Opinion: racial minorities treated fair 


Q83 


Q92h 


059g 




Choose academic career again 



SOURCE: U.S. Department of Edueation, National Center for Edueation Statisties, 2004 National Study of 
Postseeondary Faeulty (NSOPF:04) field test, 1999 National Study of Postseeondary Faeulty (NSOPF:99), 1993 
National Study of Postseeondary Faeulty (NSOPF:93), 1988 National Survey of Postseeondary Faeulty 
(NSOPF:88). 
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The 2004 National Study of Faculty and Students 
(NSoFaS) 




LETTER SENT TO CHIEF ADMINISTRATORS OF INSTITUTIONS 

WITH BOTH A 

STUDENT AND FACULTY COMPONENT 



NSoFaS 
Endorsed by 

American Association for 
Higher Education 

American Association of 
Coliegiate Registrars and 
Admissions Officers 

American Association of 
Community Coiieges 

American Association of 
State Coiieges and 
Universities 

American Association of 
University Professors 

American Councii on 
Education 

American Federation of 
Teachers 

Association for institutionai 
Research 

Association of American 
Coiieges and Universities 

Association of Cathoiic 
Coiieges and Universities 

Career Coiiege Association 

The Carnegie Foundation for 
the Advancement of Teaching 

Coliege and University 
Professionai Association for 
Human Resources 

The College Board 

The College Fund/UNCF 

Council of Graduate Schools 

The Council of Independent 
Colleges 

Hispanic Association of 
Colleges and Universities 

National Accrediting 
Commission of Cosmetology 
Arts and Sciences 

National Association of 
College and University 
Business Cfficers 

National Association for 
Equal Cpportunity in Higher 
Education 

National Association of 
Independent Colleges and 
Universities 

National Association of State 
Universities and 
Land-Grant Colleges 

National Association of 
Student Financial Aid 
Administrators 

National Education 
Association 



<DATE> 

<BOTH CA NAME> 
<INSTITUTION NAME> 
<ADDR 1> 

<ADDR2> 

<CITY STATE ZIP> 



Dear <NAME>, 

«INSTITUTION NAME» has been selected to participate in the field test of the 2004 
National Study of Eaculty and Students (NSoFaS:04), being conducted for the National 
Center for Education Statistics, part of the U.S. Department of Education, by the RTI 
International (RTI). NSoFaS is designed to collect data from nationally representative 
samples of students, faculty and instructional staff. This study provides vital information on 
changes over time in two pivotal areas of national concern: 

• How do students and their families finance education after high school? 

• Who teaches in our colleges and universities and how do they conduct their 
work? 

To make realistic plans for the future of higher education, planners and policymakers at all 
levels — institutional, state and federal — need reliable and current national data on available 
resources, and on the constraints and demands being made on higher education. In response 
to the continuing need for the data provided by NSoFaS, Congress has authorized the 
National Center for Education Statistics (NCES) to collect the data periodically. Information 
on students and student financial aid was previously collected in 1987, 1990, 1993, 1996 and 
2000 as part of the National Postsecondary Student Aid Study (NPSAS). Data on full- and 
part-time faculty and instructional staff were collected for the National Study of 
Postsecondary Faculty (NSOPF) in 1988, 1993 and 1999. These two studies are being 
conducted together to minimize the response burden to participating institutions. Additional 
information is provided in the enclosed materials, which include the NSoFaS brochure, as 
well as the brochures that will be mailed to student and faculty respondents. 

The purpose of the field test is to evaluate survey instruments and procedures so that the full- 
scale study is as effective as possible. Your institution’s participation is crucial to the success 
of the field test. Institutions selected for the field test will not be asked to participate in the 
full-scale study. I am writing to request your assistance by appointing an NSoFaS coordinator 
who will oversee the preparation of lists of faculty and students at your institution, and who 
will complete a brief Internet questionnaire on institutional policies and procedures related to 
faculty at your institution. The lists prepared by your institution will be used to draw 
samples of faculty and students for participation in NSOPF and NPSAS, respectively. 
(Both faculty and student respondents will be asked to complete their interviews on the 
Internet.) 
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The individual designated as coordinator should he someone who is familiar with data and information sources at your 
institution (such as the Director of Institutional Research). Should you require any assistance in selecting an 
appropriate coordinator (for example, we might he ahle to identify someone who has worked on these studies at your 
institution previously), you may call the NSoFaS Help Desk at 1-866-NSOFAS4. 

Federal law protects the confidentiality of all data that wonld identify individnals. Details on data collection 
procedures (including a full description of the laws and procedures safeguarding the confidentiality of questionnaire 
responses, contact information and demographic data) are provided in the enclosed brochures. 

An RTI representative will contact your coordinator to discuss the study procedures for your institution. Additional 
information about NSoFaS, including reports based on data from previous NSOPF and NFS AS studies, is available on the 
NSoFaS Web Site: https://survevs.nces.ed.gov/nsofas . If you have any questions about the study or procedures involved, 
please contact Brian Kuhr, the Project Coordinator at RTI, by telephone, at 1-866-676-3274 or e-mail ( nsofas@rti.org ). 

You may also direct questions to NCES by contacting James Griffith, at 1-202-502-7387 (e-mail address: 
James.Griffith@ed.gov ) or Linda Zimbler at 1-202-502-7481 (e-mail address: Linda.Zimbler@ed.gov ). 

The Designation of Coordinator form may be completed online at the NSoLaS Web Site, using the IPLDS UNITID 
and password printed below. 

We look forward to «INSTITUTION NAME»’s participation in this important study. Thank you for your 
cooperation and prompt completion of the enclosed NSoLaS Designation of Coordinator Form. 

Sincerely, 



Gary W. Phillips, Ph.D. 
Deputy Commissioner 



Enclosures 

The NSoFaS Designation of Coordinator Form may be completed online at: 
https://survevs.nces.ed.gov/nsofas 

IPEDS UNITID: 

Password: 
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LETTER SENT TO INSTITUTION COORDINATOR 



NSoFaS 
Endorsed by 

American Association for 
Higher Education 

American Association of 
Coliegiate Registrars and 
Admissions Officers 

American Association of 
Community Coiieges 

American Association of 
State Coiieges and 
Universities 

American Association of 
University Professors 

American Councii on 
Education 

American Federation of 
Teachers 

Association for institutionai 
Research 

Association of American 
Coiieges and Universities 

Association of Cathoiio 
Coiieges and Universities 

Career Coiiege Association 

The Carnegie Foundation for 
the Advancement of Teaching 

Coliege and University 
Professionai Association for 
Human Resources 

The College Board 

The College Fund/UNCF 

Council of Graduate Schools 

The Council of Independent 
Colleges 

Hispanic Association of 
Colleges and Universities 

National Accrediting 
Commission of Cosmetology 
Arts and Sciences 

National Association of 
College and University 
Business Officers 

National Association for 
Equal Opportunity in Higher 
Education 

National Association of 
Independent Colleges and 
Universities 

National Association of State 
Universities and 
Land-Grant Colleges 

National Association of 
Student Financial Aid 
Administrators 

National Education 
Association 



«DATE» 

«COORD NAME», «TITEE» 

«INST NAME» 

«ADDR 1» 

«ADDR2» 

«CITY STATE ZIP» 

Dear «NAME»: 

The Chief Administrative Officer of your institution has selected you as Institution 
Coordinator for the field test of the 2004 National Study of Eaculty and Students 
(NSoEaS:04). NSoEaS:04 is being conducted for the National Center for Education 
Statistics, part of the U.S. Department of Education, hy the Research Triangle Institute 
(RTI). NSoEaS is designed to collect data from nationally representative samples of 
students, faculty and instructional staff. This study provides vital information on 
changes over time in two pivotal areas of national concern: 

• How do students and their families finance education after high school? 

• Who teaches in our colleges and universities and how do they conduct their work? 

In response to the continuing need for the data provided hy NSoEaS, Congress has 
authorized the National Center for Education Statistics (NCES) to collect the data 
periodically. Data on full- and part-time faculty and instructional staff were collected 
for the National Study of Postsecondary Eaculty (NSOPE) in 1988, 1993 and 1999. 
Information on students and student financial aid was previously collected in 1987, 

1990, 1993, 1996 and 2000 as part of the National Postsecondary Student Aid Study 
(NPSAS). 

The purpose of the field test is to evaluate survey instruments and procedures so that the 
full-scale study will he as effective as possible. Your institution’s participation is 
crucial to the success of the field test. Institutions selected for the field test will not be 
asked to participate in the full-scale study. Eorms, instructions and a complete data 
collection schedule for the two component studies are contained in this binder. 

As the NSoEaS:04 Institution Coordinator for the faculty component (NSOPE), we are 
asking you to: 

Prepare and send a complete data file listing of all full- and part-time faculty, adjunct 
faculty and instructional staff (including available contact and all available demographic 
information) by December 6, 2002. The file should be current as of November 1, 2002 
or the date at your institution when faculty rosters for the Pall Academic term are 
complete. Data files for NSoEaS may be uploaded on the secure NSoEaS Web Site, sent 
by e-mail, or mailed using the pre-addressed Pederal Express air bill provided (see 
complete instructions in this binder). 
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• Complete the Institution Questionnaire online at the NSoFaS Weh Site hy December 6, 2002. To do this, 
use your IPEDS UNITID and password printed at the bottom of this letter. The questionnaire may be 
completed in multiple sittings; however. Question 1 (which asks for counts of full- and part-time faculty 
and instructional staff at your institution) should be answered at the time you send your list of faculty. A 
facsimile of the questionnaire is included in your binder. 

As the NSoFaS:04 Institution Coordinator for the student component (NPSAS), we are asking you to: 

• Complete the Coordinator Response Sheet online at the NSoFaS Web Site, within the next two weeks, 
using your IPEDS UNITID and password printed at the bottom of this letter. We will schedule data 
collection for your institution based on the information you provide. A facsimile of the Coordinator 
Response Sheet is included in your binder. 

• Coordinate collection of your institution’s student enrollment list. Prepare and send a data file to include 
all students enrolled at any time between July 1, 2002 and April 30, 2003. 

• Provide the information requested for each student who is sampled. This includes specific information on 
their enrollment status, financial assistance and demographic characteristics. 

Additional information may be found in the materials enclosed; we have provided a copy of the brochures to be mailed 
to faculty and students, as well as an NSoFaS brochure. If you have further questions, please contact the NSoFaS Help 
Desk at 1-866-NSOFAS4 (1-866-676-3274). 

Federal law authorizes this data collection and protects the confidentiality of all data that would identify 
individuals. Details on data collection procedures (including a full description of the laws and procedures safeguarding 
the confidentiality of questionnaire responses, contact information and demographic data) are provided in the materials 
enclosed. Questions about the study or procedures should be directed to Brian Kuhr, the Project Coordinator at RTI, by 
telephone, at 1-866-676-3274 or e-mail ( nsofas@rti.org ). You may also direct questions to NCES by contacting James 
Griffith, at 1-202-502-7387 (e-mail address: James.Griffith@ed.gov ) or Finda Zimbler at 1-202-502-7481 (e-mail 
address: Finda.Zimbler@ed.gov ). 

An RTI representative will contact you to discuss the study procedures for your institution. Go to the NCES Web Site 
at https://survevs.nces.ed.gov/nsofas for survey forms and detailed information about NSoFaS, including reports based 
on data from previous NSOPF and NPSAS studies. We look forward to «INSTITUTION NAME»’s participation in 
this important study. Thank you for your cooperation. 

Sincerely, 



Gary W. Phillips, Ph.D. 
Deputy Commissioner 



Enclosures 



Complete the Coordinator Response Sheet and Institution Questionnaire at: 

https://survevs.nces.ed.gov/nsofas 

IPEDS UNITID: 

Password: 
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ihn ll■mllll■i .iral ilcfam' pii^ramk liirukil hvile- I'nlrrjl ^farniin*4i ihr |uhjr'i 

iinluT ^■iiinfeBUL mpkn-cn in J crrve orpmAiima. llufVjpuKijI NP.LUuim- 

H**ipik i >ljll H:l **ilh ■hI'HIIm f*I *p>hjI rfi nt ilr^ plP^ilm< If^^.lir ilrlni- 

paf^LT jnJ cnmPrmr dju In sidnian, fncnuLs nnl uifrriiiiM.uin dbrnii plv JifiiH 

iliQi^ III |nNaa.iiiiiLf f I'duLilmi iiiS ihi: LilctliFcuw ill ouiBf; RiurRuJ aid pnift^vni cku 

»i|i iiii'inni ipuli^c r">i-.v * d\ le>>.ik iih l«iki wHikiH i^rnJkif Ji |iJdk. piiVAir 

rm-rin-priirn, jrrr^ hi|-fTiirii hit-R^iO-yrjj, - 'fnr, and -i-jmi [uuiwi ivoihry m^r^p^iiu 
NnSA> aJai j■rRllk^ ujlli^dlifalre dalj iin uiUlc||^il«c. p-xhjdiE.aul riiB'pndnuiRul 
KhIi lim iK^ili ■*l“< l*Mri"f -*-l jr4 rfjhf b-h.i 4'- 
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Basic issues 



Nttiiintl SiWt oflVtt*irwndiinf Famtljf tNSOPFJ 

MfJTffF il^iialIi m ihr biiiLuuiif nc ia i ivi pninonirilflr^ 

Niilkp. ijjiMillii'ii ihir Liii file dMa rnTi 

NUIFF jnHjitL; 

■ liiB- mini fun- luj rmw iiv lit ihiip.T 

l^]iD iJ ^■AiKirrn.^ 

" mt ik: lidilpifiinJ L^n^riiiiLi ill lut mJ jiri iiiuz iajjlip iiiA iiiB^iiLiinijI ^ull? 

■ K'lw CM^ iL> Lb.u41p |mnwulil p^ril mssBriil |^lb iir iPiiy ik iii CaJLiil^ diftj 

iM|mrniU4j 

■ H\m ^ ttiflkiiudi i/ifLijIii; jind MfinKimil -imJ p< 

mlrmlkm.*' 

N^tliiMit ni4iicLiMidiry Sl-mlmt Aid -Slwlv iNPSAil 

dill p'^fTuiE ■InmuETi fu| ilu CDfl BJ'piKiKumlBr niuiiirB, 

ihc dJilllllliriUli <wt flllitud iftL lid iIli -ilvAJEilrinJ ilf IpiiIi idnJ Mil 
nnruuliiJ BTiLerriL dnlr T^rndf*- Il'WW'h ^ r|n U 

Id tllr iLiu Irug NPiA5 

" iiiJc ~iici |i.u' urdmauri iii ihc aiiKbii iria i'uiii!h~ 

* I b'lT *■ iluibill "Hnf^ llfl lltanLiJl ajJ Innp; ritcl! 

■ ll'l-' liUiJiM4lidciilblMJi— 

■ iftf iW" I'hrinCIMlHMK Ilf I^Tt^lllU ihH- fi4lhn.Y4ilriiy •‘Jlkinilfi lA 2\ni 

jrd. hai msPA' iif ilm pmii m [UBixdiuliry 

L>atA Ajkaljlii and L)in«idiiBiHHi 

111 m4« rhf >bll t4> IwM 4« Mil ^ilMiiIi Hr^llIUlhnl li kMil 

■ |k#TfT^rvpnTinni*!^A:rFH 

■ '^fund idiidiiiiiu 

■ I!UibIiIl% 

" 4!ailBrencri liid]ii|[^ 

[W piMlCAhJIH riilB |IF|h|«aj. ilWi ‘Sl'Hi^ il iIk 'ttcb Mlc. 

liit^.‘JMirnffi.ft.TmJ jtTinyibi 





How {iiii if}e Siudy i)e Cottditcied? 



TKe lixld m itiJI urr^lz ^iic li)0 iiiKkUmi ilul mil iiknJ In pn^ik IhUi ill 

criiulbJ riadclHj rild lUMlIM lULil^iVlIHiraLllliHJ WufT C Kf I I pMWKflllPF Hill 



nalT ■ d Iw i^JiBiJr hIutbJ Jim liiH [bj. 



Thii inN^uikiki hduvciE^ Mipinanid nitn^ 

I TW Oiivl All run! I uai he CIIImci I,C!AJ^I jI nJt llulllUllUi U uiOfiJ 14 ^kUj^LTUH iH 

r^ln^llSlM IrNMIlMKMNir-i'if^nJIllfUl |li Aiifk ^i|tl KTI 

£ K 7 T UBEU.U Ju liBjBBiBd Lu cluiFp dv oiki. mc-kae jhJ rtipoiUlbiLliB. 

J 71k Irailiiuluiid f 'iiw^iiiiil uipfdlei K1 1 Willi liudaril f#.i||lY llpfl Ili^lKiflR ■‘^h 
Mlp^ber itiT liiwniiii'1 if -wiiphl liii \*m m [iiih lonjuiiwin— S?}rt >?r nr Nl'.t^i JJh 
■ il inrldiLi aintmia acd Iib&' dcmtp'^iic rdiiTm#i»ii 

4 KI1 •icia.ii I 'll irukm ^id^ ^iJi'r Inmi dam Ibli 

5 ITp! IlnllllllliiNl C^4^lrillPk ill IhIm irrwTipkiii a 'tttii'buH ^ |iBum' 

ii^in ilntn LaBnimnd ^KKi.ipracTiBi rdunJ la linikr m ihar aimBiJii |N.itUPL‘l. 

A ]1k liuiiiuiiiiiil i-HimliiiiiJi III iidn fifF. pDndei iwn«d LnKirnvnhvi Ir 4,1 

imnittnrni in^ni mJ i^t inlr nuilaiii unpbi ihi ikr buJf 

rNFiA.^1. 

»iiBlpii*i. ■■■! Kji4ifcBrfii[Jrti»- Ml idiP^iirfu- luwiiraa 



Tkev uihTm nur dAi >micwdmj laxindnii; li> hmr T|rfE nl tnnhicuDti jzd hc^lwiLl nl' Intihl 
kcepu^ dill cidf^ (^■|'JiCilkrt» tWlie 1T> IWllrW J^ijlry pflrvip^JKVi 

ir"t mipimilW kinl^n nn iirjnmnd mR* in ^hcTiig 1^ diu At u^mJ Huibm. 71le 
HihaiiE ii iiBr-friEnlJr ind ctlumii. Fw KT!f HTI lied ItiJnill bf triiUJlk- ^ MllHilllt 
darif^ ibe nuilJ ilWLIUlhnl |Adk. 



Tic l&dJ fBl klH nili^e ill Mil PtrmPII UIHiir |||^ ||»>- rruin iiid|)r, ^|ch brpnfa 

like >.%:ir kriT, Ih pjj.Jiidi|l IT^mibii It* hm' unviiui Jiirir^ ihe Hcid m nJirie: 



iusidr^>iiM.tMn rrHmMTivrn 

kpmnkrAlIJ ^11 ■piIbip Hifl 

rLhJvi <iTi 13 I n Fi^ip LBi*m lujiumJ IjhAibii 

H« i i iB r20gj ‘T il l 'k wB I ipi iii 1 iiiiii 1 iii i| hi J Vi li iiiiJi id '* 1 ifi n 1 j IKSeVH 



rVrrvkr ICBlii- i^H T. ikf V, Ym lAiUiaJ ii IfT 

’Wd-'h^J fca.hbH ^KMuiufK kpi ihHlLlPti 

^lai Utl i 1 1 '^ibn E’r^Jkwm JTTMi 

FikiBn Wl rniab^d.^amfeadkkdhilShiAA 

PUkfUTi' n 0 <- R^nL lYi iBTYAid ub ^i ib d iiiJi i uJ 1 ^ Ai PHi iwrf r •f^i'niAK' 

Maid ^ M ’ptFpi ■P 4 IMU 
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Emiorsements 

.Ar/imejiii AMiiKiatiaNjfin' tiAiTjUioN 

y^mfiftrian ^ jffjgM&vftv tiJt4 Admitmtu 
Am^fM AsiKtdamH ^ Oftnmittuif 
AiKeritJtii AmxiitfH/H ^ -StuXr CaSeges und Lhtnvrwtiti 
Amerkan ytiMKini^n ^ Unirmiiy Pn^wsson 
Amirkan i^anril aa hAaniiatt 
./4iNiiTirdif tmlemtlaai 

fir timirntmiHii 

ABfKifUijfk iij'Atttttiit^ (j^ttegn it rid Utttttrtifkr 
vtDiirNrf^ira nf Caltn(ir Codrga Snri Vaivmilin 
Camr CoBegr AaociatioH 

Jhr Ctii uejjAF humialiaa for dit .4itfuip«mnfnf af fatchirig 
(ioliejittiHd J/nnifnity 1‘ra^atiinttil AaneiatiDn H hihah ftmmriti 
tht f^vrti 
Tht CoUtff F»mVi!NCF 

ttf GniAuUa 

7Jw Covmii cf biiieprHiiaii CoSiga 
Hapanir Aimclaliim r^t'jiUtga iiaJ Llrtirenitia 

Nttiicntd Aecmiiliijg riw^iuMiv vf fl/utnturlagf >lw ^ Scitrtra ’’rpi . ,v 
pVthmnw/ .4»wwftiNr & f ■J*/«rng‘ Eutitwi ft^lvtn 

fiitiutHiii AnatiadmtJvT Ftfuid Oppiittmiity irt lidttttttiiut 

Nittrtmui Ansciatian nf iitdrpfnAnrt CuSt^ itnd Vni v t yd t i et 
hiatiaitai Atmciadaa efStait ^.^liKHiCBET cf Land-Cmrtt Ca/lijn 
iValuiriiii Av^fiittwt pNitoifiid Aid AthaaiiitTstori 

\ft$urtnJ AMMiiftitiH 



Cofijlifen} M/r fs^sttes 

ft ll InmnilkfliJi m Ific- i:''*nMCf iiff Ntti crn ihi ii^mu m «EUBa u^rmi 

rum Aun imiiiiiiiinal rro:nih iinJrr pnirliLaii ill 'ITir Niiuiul I'iLlliIIipJ S^JIIriliA i^l 

i^^-mmi i1it ISiliiiml LUuliiu y^iri[iJi.S^ lNlL\M i»f l>.^. ■ dPmJkd hnulvl-i^ 

[M All i?r .^Hl| , I4<il'inm !■■ ■'nflncr inil rftHmiriBE nlirmujiai iluiii " 

urn ld Uic Uim^ ^k^n. Ci^^uim a muj iilirn Aitn ^iii^h urrcrk I llU ^nllkS 
lluJtT^nilDtllJc^IpJi ^njti life l^r-au;r AlI i>l I'J’H. ittfdJlL> Pnki prr-.^iJw iiijvnn.li itip 
innHiliniudni' laf fvpiniu 4p ihf oJlialafc, trvpmrwfqj ud puHalM of 4 vil 11ie Fsnilr 
FiIil-wim ILpiii -LuJ Hiimy ■'^1 -of I ^'-1 iFE£PA!- C2II UJ^L. hir rfpr idi-4^- 

imrlmnrNNii r*.*cririi4ilrNnriv.-irii#rtiry'riY^^ t^uarkfi » bicaf^Tii prinrmKni 

iM'^iirvcy inxndMfi |1U LiAc". 

n^riinti-iliji iviiii H"*rdrffnl- i^nrtv 

hir BJiiriiul jvirpiwa ml n? nn Le lUkLuhI. rm lboA in -dcni^iJild hihri lin iJip v4Jhri 
nupiv:- uf^n u^rwiir Limpt.'lloi Irr lin*. 

hmiLiiBn nF Einronk FilaK'lllnl 

.M c--<^E> Imli IhtUliilPjli rtuidp AJI J aiUfkiL. |iJlLlll. Itldrf i.aipFiJk 

|iinfKibj IL jirrjMirPi ^rhiuin umI [ii **■•■*■*• iiLiu lu> (uiMiiid praronid anih rmiu-lnrl 
aiAOj cnnrnik in muirr ilm -inJf ih«n mdmLumii frnh ■ nmJ In uim ■.i'HII>^1InI h^nilri 
ru'in^r j4i>*^nJ.AJurM h> II itlf 1.‘i h |i»ivd J JN H^MUd, pcnhcn rTiriha^B nF fnwanuin 
hnr nriini uuiini in4- diu wvor iwbt chr drmriB imJI Ir uivd ^nrr buLin Lim ''kSLJ 
pruitEoJ ■ i^J nv cThj-|-p iFr daii ttstt i^Ie uilrmrl. Ad lire ■IbJi rllll^ riiiiijiki iH iFlIh Me 
|fift#«Mlll p*Cf4>.k*J. ■^Iiril- lIlH .lof m Ihfhliivil In \tpn K> cNp Hh; \mn Ewviir^ uviHilmd 
dai4. Thr dstbi^ Aiiiimaiiuly Ir^ ilir :^et iau ilvr 1*} iniiiUB ir xuj.inilp !■ ik* ukul. 
Hiii |irrFrnu iiip umiiillin‘'.i^ likT ^Niil lili’^^M^ rth‘ll^ rfrf IIIE 

miimxiM oF iFapo BtiindF 

*ii\ popci niuidi Hr UkaMJIAinnL lU k»ihi;ij ul»«M^ A #rilpj| niRli h«.Tnilir3iifvi 

Irm |hr KaiHLd vuinry KurvlHr in oJituI llll oiK be innnl Jiti nuiiEa^nJ nJi 
imrv (Ufmifinr ^ jmmi ifpiiiu dlfLUauK irl LuxUdcEasl dju 

I'r^pMiniv uffjBa -Fie hhlk O^ua 

All lETiEd ill dc pnaal IliiF cuiiifJr:, flclrilkjl lah'nl nill ht ilnluird «c;,lllrfl 

c wdl IpH lie |ili»ihk m KklllifK rfc Hldir-llNll 

Aii^ihk- ^k< MiikAn ik- LMll'k-aiuHlk |ir.:iPHl«|| rif |||H Bhill Ihif^ ^h^f 'ill? ^i\\ >ly 
Fnilhi Ruhy liF l AfanB* Uid ^n hr Lnpvi»«nL up ui En van. nJl'm bad up 

m USu474tJ. 
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Tki ^knrMf a^HiKvt*ra rruwiK ih mArV 

‘■■Nhlm.iiHd ili^1 h |nv4njjiiJiFr 

jtbI ri'B'Lii^ M.h4irr i14 

•f .^UTii'jn AMifLaiwi rer Hl^r UiL'Jihii 
•f •'iiiniiin iltvlBirTn Ppp.iiirn 

ilkl J^LllUUlU CldLYMi 

+ ^■tinn I»MJ1 tJ I’f Tiip I 'jfVf 

*■ Aki^mh it bcBX 4 .iJLc^ 

ITkJ LtMIAKI 

^ AriBHlJI AMi’uiJ€4l it LAlFiTTirh' (VllbiUk 

▼ Aiunan lucWiL 

f AoMizim in tuiBJinad Ibsucb 
^ .^0»uvH^ 4C Ajmiui {ruMci^ inJ 'LriPTT^Kii 
.'^nddNjil J Gilqgd- «tJ LkJMiUte 

^ Tki fioinlfliiN r»i iki.4iJwmn«n 

irnrioHvr^ 

Lkiiimrr tn^Biwnl Ah>obbi 

£b IhlflHI -blUKlI 

▼ TkiCfrB^ EkbXiJ 

^ ThcCibiFFiMvJiVI^ 

■ TkJ r.awi.11 It Irib^i^aUw E^ki^ 

^ Hs^mmc .4ancum rd Ll^kf^xid LVimnna 
* ^hikiul AiuKkiME >1 Crdk^ uJ Lirmiir 

tailffU L?lTh3D 

*• Slipnil Aivji.>lnh b< Eqid (Hhi^ltarilr 
uiKpka Elbsjinft 

*■ ‘^Iknil Amkinp pt 

HiJ 1 'imHio 

^ ^iFnil i^nLklPTF' p 4 '^r L’liHjaiiiii 

utJ Lnd-Cjiiii 4Ti4k|i^ 

a VilbiMl AiK<k4trffe M* |!h4«ii HnN'aiI Al# 

.Upirmin 



t'jlindinildlli) 

I Ik J9H tekJr fI IWidrr 

ihiiOrf- l* 4 i Bkiw«>BAfall>jiilT!SBra^C^Kr 
Tn* Edu.^i« VkiNl^K ISTE^* af [Vf^mipm 

■ ^ "I ik* h^iiPMid 

AijfiJ hh<i rjUL. ihiriju|i»L'jL: 
■Jill ■lk4||.ll.L:vlCU^lfcluiAk^u«d 
An. dr hrmT An il l'.■-’A j <• U LC ^SiiL ril iki 
■.ilAMIhRTTAirirAlll " " ji 

it rrdvmai <1 •4wiprd Tmi hJrndidi vir^fid m 

K|^ri|T ji ^mral \w t piiiHi i«kid U* 

IbilL 



HIA | 1 |F — J k, Ikj |^r||tr«kla |^•4 

jfk ibllMj W ihn k y ihr 

ns ELndrj^Tdic nJaikulL >dJ ir^mx'iEM Eiar 
lii II ikBiik. iJLiitfiBk tkamnmA^ liJmJadj 
EPir Iv npl ^ ibiiimI prfiiC'aiJ nir 

!■ iIbIbmI fm p^l !■ Jb aiflijir |^i i(Bp iBlpd 

ip4pp •■k" ••m I* Ir"" 

>11 ^r\ (> 1^.4 bil/kkilUla »•> 

ItalH 1 ^ jJLkJinU kd aiJ lU pThUllul 

Ipi ly* Ekn lb ■kul.liJ ll^lllUhil firi jJklkkh^ 
iilcidiii ArHunkauh 

If pu Ian i^xriiM i4ui paw i^iai ■ i amtp (pinp. 
Imh. pii ran . 1 ^ ULn'i lanmuad Irricv Uard 

pri I w nbmridiTrM^d '' pt 

I Mi. rM ,U^lpiiJ3|.i ^^\ 



^■1 laa lb i|Ha[lBBlqap H anp|f 

Lui lh« jbfcj K VUAJi| idT aMl Mb* 

^ii nan rriimMAi hum rii AJhanif 



db hCn|^r^ ^IduJn 

V»«i ni*rca» 
L-Ub-MKl^rrCA 
I >lWu«7i-''AH 



rj-4k< 

MTFA Pnini tur^. 

I JU-^U-TftlE 
LlBb.ZuJiaiM.pfl 



i^a 





Cevvt fa Eduaiin iiaiBU 
f^TwiiKi". ^TJkaap^ 

DC 




inviei^ --Ik K.inii||jl C>nin K*» Fj^irflinii 'nu-iprin. 1 Imnti) nii|i*iJi»i« t>(- FHik=rin<. ‘WVhinpnii. 



Ny^TIONAL 

sri'L^DV 

ov 

POSTSECOWDARY 
FACL'LTV 





Exinibil^ Inr 
RTI l■ 1 nlBl■■)«#' 
FWAliTHiifii^rilkMC 



•SiiIjK 

Tk Hik-hI C41Kd 

B aaaaUii^ ihi diirit LfE^ ^dic fbumd: !NiJj' 
afTliwp !■ liB| Puik^ i.MZ'Ttl*) H w^-vd ai ilb 
cnTuuvp iKsI Iv bn«F 'bukp niJ 

ifprtM.4mul ridT iJ^pr afi> iSrtiClk dini itlhcd^^lr 

ariABJwti h |wi Lm Jua4tip iMlMliutp 

Fnirr nordm nl luivaHmJ Bdfm la^id w 
j ipakir puKEuaduT cdnnnL 1 Tet iJrKiiiiir 
•Ejjm.iljn LiHiEii. Mukn frrkvnuju nnJpih. 

•dKl IWd^dEij' |HA44ril»<r-fiirf<dK 
I ^aJr)i‘ rwdifn fwtm muidi aid ikvak^Hvii 

iwL ififl uhuk BUBid'iky auiaaj ladiutf^ij 
rid mMfnkmlnBfmiTii il~|Tifc Tlim^k dial 
nddr. 'b'vt.e HU>^nk llry i.aMlRrBlr li< ibr 
ridip. Ra iKvr lan^ H m a<ip4ilarl M 

Lf^BpVh^ 4fkl [■Jkrpiukjp^rit^ l|iki|fr^hl b+Bt iB-lJn* 

mt: vlia Aiydtc aid d*iJtl kan ikpr vduiif^af 
aw ura 

UmAtp LOUMhd |i I 1?^. dPpI 
;alnl 3ikSl.>rhli;, 3£Uft-.-Atk. aad NUd'l 
i^wmiidp'i ^Mdud uiibAA iiaiaa n dupaa- 
usanlirt atmuiiT. Hsi ppavakd iBml 
aTbidlp ml iirilia.iiJiaJ diFId tp ai tnaadi lr 
iliHitppta In dfi: LhiELcd 5aitn NIdMHi LEwJiPHikp 
hi pudbi’^dV •PfJ ^ixl Ul'^|K#h(i Mi 

nrmnoal |wdKw:nJ fnccoi ikn ifaj ^akv 
rkJ PBiuMul udT. 

rt^rooiA M itit ;bu n^pihI Mb -rT 

IVuwsniify Fmb, INiOldiMI vdl-nput ihi 
nhauflaa jlnii haaJrp ud uiiruviuJ raf h nn 
VT^nma arn: |l| i rfl ibw ILa nrifamH tu he 
NaJeuan n evttU p iiiirf if liriE. diJ il 
r>i4nrUind HHompfiiiH hiidti' aid iH^i 
\'m.i 4 icift ilM! Md> 



4 



BP T | i |i i ibpnr 
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AjufrEud ObiKiiw 

it i tiiMY 

pHr»pr^ '.tp KHln 4^. 

^ J byiVUihlAL Tiv UbkJi' IN Llin J Lta bkr if in 
■ ■Mn«id ■ nnniGhvi ^touBMih nmnif 
(ftiLid tncnn^ laihp. i^lvrnaipn 

•^Iriiird IrMii lJp. 1 T ■whn imi ii a iN i 

fwipiw piminiiiAir!i -nivnimL «vii ■ iFs 

+ H-^ nnr hdh hhI ifin^irr ladir 

0 «l nm llprr'' 

T in thir tLiucikm:!! 

•f in dwu M<LL^i uJ kiM N L^'r iLTw 

iUznod L^ipviiii lIhuib. wirmiiri m\A nkn 
■ihrilnJ' 

+ ire ttc laiTTB lcsbb|.piBlKn.B^ u 

urtsdaniJr-p uruif i^jmjiinlaT ^bJjf bi^ 
«rHnp.H|pred riiV 

+ hkw wifJinJ irr [Ji> iiiirmi '■■ihiRir 

aipj bi^|lif4a^ 

+ H n 1 rBhJTT irwJ iruimind BtTnfriiinTrri 
kr ilirir femniPWK Hrw ireprnri ire i^rt 

Euuj^ 

^ rer ihr rer*ii ird "liiiiii ii |4«Ea ■! 

hlUlu'dhiiJ UJ^ 

+ Vkac muRrm pik^D si ni^4c n 6oiW 
«id njim.ih^ hpF 

* I4^*' lFcr |■^•n ^ pmir^ 

NilUN b’l l^jJlh IWmJwn/ AjV liloi^-L^JJk 

II Hr FfcCi^ 




>iw KSOPf Will ^ CQnJKHHJ 

tiir M«k 4 yJ *Jttm Am Lkuikit htoNkb iSlLai 

K«p »Hli HTI lirniNknil fFTII 

i«nU.t iIv JHh (MVLli'FdHI. Ef I * ii 

in^pkol^re:. hrpniTi eubvi m^ach iiiuKiJiin 
Fmipd ti ^cnibTniMik' l^rk. Hla. ^amiK 
IhdfnJ Lt i ^vd. Klim \4 ibc ^brer mt^ luJriiHlm- 
Ir h 4 cflh Csi 4 Jh: UiireTvtr ref CiPfdm.« 
II^I.N'^HiC-^^llv 

LitAi LUMnCf. m lb|^ <^EXhiH Ul IVIM iiJ 

ku <Enm rm»n m KCElt hi riHia • 

■ TpJrr mmb ihl iv^TK li> IV ?1 

-J 1 1 ^ 31 .W fRiJip 

dlJ IIWTuaTiiHj ^I'.vUi yd tUB f.yiT' l^ffl ri 
iHiiikJLin in itf W tiMh hA iki; Llwia iJ* 

I4i»i II if 

uuJr. w ur nui^b.iir^ iku. Ud ui il L,J 4 b b^ulrr 
i&d iPBiu^miiJ mJT hnri b unfif v( l^ll iiviiir 

Yi^ Lre dbk Bi «» At ^^Ff ^Lj iH 
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NSOPF:04 

Endorsed by 

American Association for 
Higher Education 
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Coliegiate Registrars and 
Admissions Officers 
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Land-Grant Colleges 
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LEAD LETTER TO FACULTY January 30, 2003 

FACULTY NAME 
ADDR 1 
ADDR2 

CITY STATE ZIP 
Dear Colleague, 

I am writing to ask for your participation in an important study of postsecondary faculty and 
instructional staff in the United States. The National Center for Education Statistics (NCES) is 
conducting the fourth cycle of the National Study of Postsecondary Faculty (NSOPF) to collect 
data on the background characteristics, workloads, and career paths of faculty and instructors. 

You were selected as part of a nationally representative sample of faculty and instructional staff to 
take part in the field test portion of this study. A brochure about the study and instructions for 
completing the survey are enclosed. 

As part of your participation, we are asking that you complete a questionnaire over the Internet 
about your background and experiences, and your job at «INSTITUTION NAME». All 
responses that relate to or describe identifiable characteristics of individuals may be used only for 
statistical purposes and may not be disclosed, or used, in identifiable form for any other purpose, 
unless otherwise compelled by law. Additional information on the laws and procedures protecting 
confidentiality may be found in the enclosed brochure. 

[If no incentive: Your involvement in testing the questionnaire items, while voluntary, is critical to 
the study’s success. On average, the questionnaire takes about 30 minutes to complete. Faculty 
and instructional staff selected in the field test will not be asked to participate in the full-scale 
study scheduled for the 2003-2004 school year.] 

[If incentive: Your involvement in testing the questionnaire items, while voluntary, is critical to 
the study’s success. On average, the questionnaire takes about 30 minutes to complete. If you 
complete the web questionnaire by February 11, 2003, you will receive either a $20/30 check or 
gift certificate from Amazon.com as a token of our appreciation. Faculty and instructional staff 
selected in the field test will not be asked to participate in the full-scale study scheduled for the 
2003-2004 school year.] 

To respond to the questionnaire over the Internet: 

• Go to: https://survevs.nces.ed.gov/nsopf/ 

• Type the study ID and password (see below) on the Home/Login page, and 

• Press “Enter” or click “Login” to begin the questionnaire. 

To respond to the questionnaire by telephone with one of our trained interviewers, or ask questions 
about the study: 

• Call 1-866-NSOPF04 (1-866-676-7304). 

The study is being conducted for the National Center for Education Statistics by our contractor, 
RTI International. If you have questions or comments regarding the study, you may contact the 
RTI Project Director, Dr. Maggie Cahalan, at 1-866-676-7304 (e-mail address: nsopf@rti.org) or 
the NCES Project Officer, Linda Zimbler, at 1-202-502-7481 (e-mail address: 
Linda.Zimbler@ed.gov). 

Thank you for your participation in this important and useful study. 

Sincerely, 



C. Dennis Carroll, Ph.D. 
Associate Commissioner 
Postsecondary Studies Division 

Enclosures 



Go to: https:// survevs.nces.ed.gov/nsopf/ 
Your study ID: «ID EILL» 

Your password: «PASSWORD EILL» 
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How TO Complete the 
NSOPF:04 Field Test Questionnaire 

[If no incentive: Please accept a thank you from the U.S. Department of Education for 
completing the 2004 National Study of Postsecondary Faculty (NSOPF:04) Field Test 
questionnaire on the web. To meet our schedule, we would like to receive your responses by 
February 11, 2003. Your participation is very important to the success of NSOPF:04.[ 



[If incentive: As a token of our appreciation, if you complete the 2004 National Study of 
Postsecondary Faculty (NSOPF :04) Field Test questionnaire on the web by February 11, 
2003, you will receive either a $20/30 check or a $20/30 gift certificate from Amazon.com 
(your choice). Your participation is very important to the success of NSOPF :04.[ 



To complete the self-directed web questionnaire: 



1. Goto: https://survevs.nces.ed.gov/nsopf/ 

2. At the login and password prompts, enter the study ID and password 
printed below: 

Study ID: 

Password: 

3. Press “Enter” or click “Login” to begin the questionnaire. 

If you need assistance in completing the self-directed web questionnaire or if 
you would like to complete the questionnaire over the phone, please call our 
Help Desk at 1-866-NSOPF04 (1-866-676-7304) for assistance. 



While you may complete the NSOPF web questionnaire throughout the data 
collection period, we will begin calling sample members to complete the 
^|uestionnmr^ve^h^hon^tartin^ebru^^^^003 



For more information about this study visit the web site at: 

https://survevs.nces.ed.gov/nsopf/ 



NOTE: Public reporting burden for this information request in its entirety is estimated at 30 minutes per response. You 
may send comments regarding this burden estimate or any other aspect of this collection of information, including 
suggestions for reducing this burden, to the U.S. Department of Education, Information Management and Compliance 
Division, Washington, DC 20202-4651; and to the Office of Management and Budget, Paperwork Reduction Project 
1850-0608, Washington, DC 20503. 
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E-MAIL PROMPTS TO FACULTY 



===SHORT VERSION=== 

Dear Colleague: 

We are writing to urge your timely completion of the field test questionnaire for the National Study of 
Postsecondary Faculty (NSOPF), conducted by the National Center for Education Statistics (NCES). As 
indicated in our letter dated January 29, you were selected as part of a nationally representative sample for this 
major US Department of Education study. 

We are keenly aware of how busy faculty and instructional staff are, which is why we developed a web version of 
the questionnaire as a convenient way to participate in this important study. IF INCENTIVE: If you complete the 
questionnaire by February 17, 2003, you will receive either a [$20/30] check or gift certificate from Amazon.com 
as a token of our appreciation. 

To access the web survey, go to https://survevs.nces.ed.qov/nsopf and log in using: 

Study ID: «caseid» 

Password: «password» 

If you need help completing the survey on the web or you prefer to complete the survey by telephone, please call 
the Help Desk at 1-866-NSOPF04 (1-866-676-7304). Thank you again for your participation in this important 
study. 

Sincerely, 

Dr. Maggie Cahalan 
RTI Project Director 



===== long version === 

Dear Colleague: 

We are writing to urge your timely completion of the field test questionnaire for the National Study of 
Postsecondary Faculty (NSOPF), conducted by the National Center for Education Statistics (NCES). As 
indicated in our letter dated January 29, you were selected as part of a nationally representative sample for this 
major US Department of Education study. At a time of rapid change in postsecondary education, NSOPF will 
provide critical updated information on the characteristics, workload and career paths of faculty and instructional 
staff in the United States. 

To adequately represent the full range of faculty and instructional staff throughout the nation, all persons having 
any full or part-time instructional duties, or having faculty status in fall of 2002, are eligible for inclusion. The 
participation of each field test sample member is very important to test our procedures. 

We are keenly aware of how busy faculty and instructional staff are, which is why we developed a web version of 
the questionnaire as a convenient way to participate in this important study. IF INCENTIVE: If you complete the 
questionnaire by February 17, 2003, you will receive either a [$20/30] check or gift certificate from Amazon.com 
as a token of our appreciation. 

To access the web survey, go to https://survevs.nces.ed.qov/nsopf and log in using: 

Study ID: «caseid» 

Password: «password» 

If you need help completing the survey on the web or you prefer to complete the survey by telephone, please call 
the Help Desk at 1-866-NSOPF04 (1-866-676-7304). Whether by web or telephone, we urge you to complete the 
questionnaire and provide any feedback you might have to us at the end of the survey. Thank you again for your 
participation in this important study. 

Sincerely, 

Dr. Maggie Cahalan 
RTI Project Director 
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NONRESPONSE LETTER TO FACULTY, FIRST FOLLOW-UP 

February 14, 2003 



NSOPF:04 

Endorsed by 

American Association for 
Higher Education 

American Association of 
Coliegiate Registrars and 
Admissions Officers 

American Association of 
Community Coiieges 

American Association of 
State Coiieges and 
Universities 

American Association of 
University Professors 

American Councii on 
Education 

American Federation of 
Teachers 

Association for institutionai 
Research 

Association of American 
Coiieges and Universities 

Association of Cathoiio 
Coiieges and Universities 

Career Coiiege Association 

The Carnegie Foundation for 
the Advancement of 
Teaching 

College and University 
Professional Association for 
Human Resources 

The College Board 

The College Fund/UNCF 

Council of Graduate Schools 

The Council of Independent 
Colleges 

Hispanic Association of 
Colleges and Universities 

National Association of 
College and University 
Business Cfficers 

National Association for 
Equal Cpportunity in Higher 
Education 



FACULTY NAME 
ADDR 1 
ADDR2 

CITY STATE ZIP 
Dear Colleague: 



We are writing to urge your completion of the field test questionnaire for the National 
Study of Postsecondary Faculty (NSOPF), conducted by the National Center for 
Education Statistics (NCES). As indicated in our letter dated January 29, you were 
selected as part of a nationally representative sample for this major U.S. Department of 
Education study. At a time of rapid change in postsecondary education, NSOPF will 
provide critical updated information on the characteristics, workload and career paths of 
faculty and instructional staff in the United States. 

To adequately represent the full range of faculty and instructional staff throughout the 
nation, all persons having any full- or part-time instructional duties, or having faculty 
status in fall of 2002, are eligible for inclusion. The participation of each field test 
sample member is very important to test our procedures. 

We also need to inform you that we experienced a minor technical difficulty on February 
11, and we temporarily disabled the web site. Corrective measures have been taken and 
the web site is once again available. However, we have taken a precautionary measure 
to protect respondents' confidentiality by changing passwords for some study 
participants. Please only use the study ID and password listed below to access the 
questionnaire. It may or may not be the same as the password listed in the original 
letter you received. 

[IF INCENTIVE: To compensate for this unavailability of the web instrument, we are 
extending the incentive period for this study. If you complete the questionnaire by 
Eebruary 23, 2003, you will receive either a [$20/30] check or gift certificate from 
Amazon.com as a token of our appreciation.] 

[IE NO INCENTIVE: To compensate for this unavailability of the web instrument, we 
are extending the period before we begin phone follow-up data collection for this study. 
We would greatly appreciate your participation by web by Eebruary 23, 2003.] 

To access the web survey, go to https://survevs.nces.ed.gov/nsopf and log in using: 

Study ID: <ID EILL> 

Password: <PASSWORD EILL> 



National Association ot 
Independent Colleges and 
Universities 

National Association of State 
Universities and 
Land-Grant Colleges 

National Association of 
Student Financial Aid 
Administrators 

National Education 
Association 



If you need help completing the survey on the web or if you prefer to complete the 
survey by telephone, please call the Help Desk at 1-866-NSOPE04 (1-866-676-7304). 
Whether by web or telephone, we urge you to complete the questionnaire and provide 
any feedback you might have to us at the end of the survey. Thank you again for your 
participation in this important study. 

Sincerely, 



Dr. Maggie Cahalan 
RTI Project Director 
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NONRESPONSE LETTER TO FACULTY, SECOND FOLLOW-UP 



NSOPF.04 
Endorsed by 

American Association for Higher 
Education 

American Association of 
Coiiegiate Registrars and 
Admissions Officers 

American Association of 
Community Coiieges 

American Association of State 
Coiieges and Universities 

American Association of 
University Professors 

American Councii on Education 

American Federation of Teachers 

Association for institutionai 
Research 

Association of American Coiieges 
and Universities 

Association of Cathoiic Coiieges 
and Universities 

Career Coiiege Association 

The Carnegie Foundation for the 
Advancement of Teaching 

Coiiege and University 
Professionai Association for 
Human Resources 

The Coiiege Board 

The Coiiege Fund/UNCF 

Councii of Graduate Schoois 

The Councii of independent 
Coiieges 

Hispanic Association of Coiieges 
and Universities 

Nationai Association of Coiiege 
and University Business Officers 

Nationai Association for Equai 
Opportunity in Higher Education 

Nationai Association of 
independent Coiieges and 
Universities 

Nationai Association of State 
Universities and 
Land-Grant Coiieges 

Nationai Association of Student 
Financiai Aid Administrators 

Nationai Education Association 



April 16, 2003 

FACULTY NAME 
ADDR 1 
ADDR2 

CITY STATE ZIP 
Dear Colleague: 

We are writing again to request your participation in the U.S. Department of 
Education’s study of postsecondary faculty and instructional staff. The U.S. 
Department of Education has requested that RTI International test the procedures for 
the next National Study of Postsecondary Eaculty and the appropriateness of 
questionnaire items for full- and part-time employees of postsecondary institutions 
who were faculty and/or who had some instructional duties in the fall of 2002. 

Because we are keenly aware of how busy you are, we have developed a web version 
of the questionnaire as a convenient way for you to participate. All of your answers 
will be completely confidential and will not be released in any form that could lead to 
your identification. Your answers will be secured behind firewalls and will be 
encrypted during Internet transmission. All identifying information is maintained in a 
separate file, and will never be linked to the answers you provide. 

NEXT SENTENCE IS ONLY FOR NONRESPONSE INCENTIVE CASES 
: As a token of our appreciation for completing the questionnaire, we would like to 
send you either a $30 check or gift certificate from Amazon.com. To access the 
questionnaire on the web or to obtain more information about the study, go to 
https://survevs.nces.ed.gov/nsopf and log in using your 

Study ID: «caseid» 

Password: «password» 

If you need help completing the questionnaire on the web or if you prefer to participate 
by telephone, we have a staff of professional interviewers available to assist you at 1- 
866-NSOPF04 (1-866-676-7304). 

Thank you in advance for your participation in this very important study about faculty 
and instructional staff in the United States. Your participation is critical to its ultimate 
success. 

Sincerely, 



Linda Zimbler 
NCES Project Officer 

E-MAIL ONLY: To ensure that as many sample members as possible receive this 
message, you may also receive a copy via U.S. mail. 
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NONRESPONSE LETTER TO FACULTY, THIRD FOLLOW-UP 



NSOPF:04 
Endorsed by 

American Association for 
Higher Education 

American Association of 
Coliegiate Registrars and 
Admissions Officers 

American Association of 
Community Coiieges 

American Association of State 
Colieges and Universities 

American Association of 
University Professors 

American Councii on Education 

American Federation of 
Teachers 

Association for institutionai 
Research 

Association of American 
Colieges and Universities 

Association of Cathoiio 
Colieges and Universities 

Career Coiiege Association 

The Carnegie Foundation for 
the Advancement of Teaching 

Coliege and University 
Professionai Association for 
Human Resources 

The College Board 

The College Fund/UNCF 

Council of Graduate Schools 

The Council of Independent 
Colleges 

Hispanic Association of 
Colleges and Universities 

National Association of College 
and University Business 
Cfficers 

National Association for Equal 
Cpportunity in Higher Education 

National Association of 
Independent Colleges and 
Universities 

National Association of State 
Universities and 
Land-Grant Colleges 

National Association of Student 
Financial Aid Administrators 

National Education Association 



May 16, 2003 



FACULTY NAME 
ADDR 1 
ADDR2 

CITY STATE ZIP 
Dear Colleague: 

The National Study of Postsecondary Eaculty (NSOPF) needs your help in order to 
portray an accurate picture of the Nation’s postsecondary educators. I hope that with 
the end of the school year, your schedule will allow time for you to complete the 
NSOPF questionnaire. As someone who plays a crucial role in education, I am sure 
you can appreciate the importance of having an adequate representation of the diversity 
of the nation’s faculty and instructional staff. This U.S. Department of Education 
sponsored study will provide critical information on the background characteristics, 
workloads, and career paths of faculty and instructors in postsecondary institutions. 
Your experiences and opinions are very important to the success of this study. 

INCENTIVE CASES ONLY: As a token of our appreciation for completing the questionnaire, 
we would like to send you either a $30 check or a gift certificate from Amazon.com. 

To access the questionnaire on the web or to obtain more information about the study, 
go to https://survevs.nces.ed.gov/nsopf and log in using your 

Study ID: «caseid» 

Password: «password» 

If you need help completing the questionnaire on the web or if you prefer to participate 
by telephone, a staff of professional interviewers are available to assist you at 1-866- 
NSOPF04 (1-866-676-7304). 

Please be assured that your answers to the questionnaire items will be completely 
confidential and will not be released in any form that could lead to your identification. 

I appreciate your contribution to this very important research. 

Sincerely, 



Linda Zimbler 
NCES Project Officer 

E-MAIL ONLY: To ensure that as many sample members as possible receive this 
message, you may also receive a copy via U.S. mail. 
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NONRESPONSE LETTER TO FACULTY, FOURTH FOLLOW-UP 



NSOPF:04 
Endorsed by 

American Association for Higher 
Education 

American Association of 
Coilegiate Registrars and 
Admissions Officers 

American Association of 
Community Coileges 

American Association of State 
Coileges and Universities 

American Association of 
University Professors 

American Councii on Education 

American Federation of 
Teachers 

Association for institutionai 
Research 

Association of American 
Coileges and Universities 

Association of Cathoiic Coiieges 
and Universities 

Career Coiiege Association 

The Carnegie Foundation for the 
Advancement of Teaching 

Coiiege and University 
Professionai Association for 
Human Resources 

The Coiiege Board 

The College Fund/UNCF 

Council of Graduate Schools 

The Council of Independent 
Colleges 

Hispanic Association of Coiieges 
and Universities 

Nationai Association of Coiiege 
and University Business Officers 

National Association for Equal 
Opportunity in Higher Education 

National Association of 
Independent Colleges and 
Universities 

National Association of State 
Universities and 
Land-Grant Coiieges 

National Association of Student 
Financiai Aid Administrators 

National Education Association 



June 9, 2003 



FACULTY NAME 
ADDR 1 
ADDR2 

CITY STATE ZIP 
Dear Colleague: 

I am writing today to let you know that the field test period for the National Study 
of Postsecondary Eaculty (NSOPF) is quickly drawing to a close. We hope that 
you will find the time between now and Monday, June 30, 2003 to complete the 
web or telephone version of the interview. 

As we have mentioned in previous correspondence, this U.S. Department of 
Education-sponsored study will provide critical information on the background 
characteristics, workloads, and career paths of faculty and instructors in 
postsecondary institutions. Because you have been selected to represent thousands 
of other faculty and instructional staff, your experiences and opinions are key to the 
success of this study. Any answers that you provide will be kept completely 
confidential and will not be released in any form that could lead to your 
identification. 

As a token of our appreciation for completing the questionnaire on or before June 
30, 2003, we would like to send you either a $30 check or gift certificate from 
Amazon.com. 

To access the questionnaire on the web or to obtain more information about the 
study, go to https://survevs.nces.ed.gov/nsopf and log in using your 

Study ID: «caseid» 

Password: «password» 

If you need help completing the questionnaire on the web or if you prefer to 
participate by telephone, professional interviewers are available to assist you at 
1-866-NSOPF04 (1-866-676-7304). 

On behalf of the National Center for Education Statistics, U.S. Department of 
Education, I would like to thank you in advance for your participation in this very 
important research. 

Sincerely, 



Linda Zimbler 
NCES Project Officer 

E-MAIL ONLY : To ensure that as many sample members as possible receive this 
message, you may also receive a copy via U.S. mail. 
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NSOPF Field Test Telephone Interviewer Training Agenda 
Day 1 - Saturday, February 22, 2003 



9:00a -9:45a 


Welcome and Introduction (45 min) 

-Introduction of Project Staff, Review manual 
-Background/purpose of study, Sample 


9:45a -10:00a 


Confidentiality (15 min) 

-Sign/notarize eonfidentiality agreements 


10:00a -10:30a 


Demonstration Moek (30 min) 

-Audio-taped with data view projeetion of screens 


10:30a -10:45a 


Small group diseussion of survey/FAQs (15 min) 


10:45a-l 1:00a 


Break (15 min) 


ll:00a-12:30p 


Q X Q Review (90 min) 

-Review sections and important questions 


12:30p-l:15p 


Luneh Break (45 min) 


l:15a-2:15p 


Round Robin Moek #1 (60 min) 


2:15p-3:00p 


Open-Ended Coding Praetiee (45 min) 
trainer leeture, praetiee 


3:00p-3:15p 


Break (15 min) 


3:15p-4:15p 


Refusals (60 min) 

-trainer leeture, paired praetiee in groups/listening 


4:15p-4:55p 


Front-End Praetiee (40 min) 

-loeating/multi-roster front-end praetiee 


4:55p-5:00p 


Wrap Up/Questions (5 min) 
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Day 2 - Sunday, February 23, 2003 



9;00a-9;15a 


FAQ Review (Oral Quiz) (15 min) 


9;15a-10;15a 


Round Robin Moek #2 (60 min) 


10:15a-ll:00a 


Written Exercises (45 min) 
-FAQs, Refusals 


ll:00a-ll:15a 


Break (15 min) 


ll:15a-ll:35a 


Open-Ended Coding Exercise (20 min) 


ll:35a-12:35p 


Certification Interviews - (60 min) 


12:35p-l;00p 


FAQ Certification (25 min) 

-Oral quiz of most commonly asked questions 
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Codes 




1988 


1993 


1999 


2004 


CIP 


Label 








1 




Agriculture, natural resources and related sciences 


002 


102 


102 


101 


01 


Agriculture and related sciences 


003 


103 


103 


102 


03 


Natural resources and conservation 


005-009 


121-130 


121-130 


2 




Architecture and related services 








201 


04 


Architecture and related services 








3 




Area, ethnic, cultural, and gender studies 








301 


05 


Area, ethnic, cultural, and gender studies 








4 


50 


Arts - visual and performing 


010 


141 


141 


401 


50.0703 


Art history, criticism, and conservation 








408 


50.0402 


Commercial and advertising art 


012 


143 


143 


409 


50.03 


Dance 


013 


144 


144 


402 


50.04 


Design and applied arts 


014 


145 


145 


403 


50.05 


Drama/theatre arts and stagecraft 


015 


146 


146 


410 


50.06 


Film/video and photographic arts 


016 


147 


147 


404 


50.0702 


Fine and studio art 


017 


148 


148 


405 


50.0901 


Music 


018 


149 


149 


406 


50.0902 


Music history, literature, and theory 


019 


150 


150 


407 


50.99 


Visual and performing arts, other 








5 


26 


Biological and biomedical sciences 


100 


391 


391 


501 


26.02 


Biochemistry, biophysics and molecular biology 


094 


393 


393 


502 


26.03 


Botany/plant biology 


100 


394 


394 


503 


26.08 


Genetics 


100 


395/396 


395/396 


504 


26.05 


Microbiological sciences and immunology 


98 


397 


397 


505 


26.09 


Physiology, pathology, and related sciences 


99 


398 


398 


506 


26.07 


Zoology/animal biology 


100 


400 


400 


507 


26.99 


Biological and biomedical sciences, other 








6 


52 


Business, management, marketing, and related support services 


020 


161 


161 


601 


52.03 


Accounting and related services 


022 


163 


163 


602 


52.02 


Business administration, management, and operations 


023 


164 


164 


603 


52.04 


Business operations support and assistant services 


021 


162 


162 


604 


52.08 


Finance and financial management services 


024 


165 


165 


605 


52.10 


Fluman resources management and services 


026 


167 


167 


608 


52.12 


Management information systems and services 


027 


170 


170 


606 


52.14 


Marketing 








607 


52.99 


Business, management, marketing, and related support services. 












other 








7 




Communication, journalism, communication technologies, and 












related programs 


028-030/ 


181-183/ 


181-183/ 


701 


09 


Communications, journalism, and related programs 


032 


190 


190 








031 


184 


184 


702 


10 


Communication technologies 








8 


11 


Computer and information sciences and support services 








801 


11.10 


Computer/information technology administration and management 


202 


202 


202 


802 


11.02 


Computer programming 


201 


201 


201 


803 


11.07 


Computer science 


204 


204 


204 


804 


11.08 


Computer software and media applications 








805 


11.05 


Computer systems analysis 


203 


203 


203 


806 


11.09 


Computer systems networking and telecommunications 


201 


201 


201 


807 


11.06 


Data entry/microcomputer applications 


210 


210 


210 


808 


11.03 


Data processing 








809 


11.04 


Information science/studies 








810 


11.99 


Computer and information sciences and support services, other 


122-125 


601-610 


601-610 


9 


46 


Construction trades 








901 




Construction trades 
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Codes 




1988 


1993 


1999 


2004 


CIP 


Label 








10 


13 


Education 


040 


223 


223 


1013 


13.02 


Bilingual, multilingual, and multicultural education 


041 


224 


224 


1001 


13.03 


Curriculum and instruction 


042 


225 


225 


1002 


13.04 


Educational administration and supervision 


043 


226 


226 


1014 


13.06 


Educational assessment, evaluation, and research 








1003 


13.05 


Educational/instructional media design 






228 


1015 


13.0406 


Higher education/higher education administration 


045 


228 


229 


1004 


13.10 


Special education and teaching 


046 


229 


230 


1005 


13.11 


Student counseling and personnel services 


047 


230 


231 


1006 


13.99 


Education, other 


048 


241 


241 


1007 


13.1210 


Teacher education: Early childhood education and teaching 


049 


242 


242 


1008 


13.1202 


Teacher education: Elementary education and teaching 


050 


243 


243 


1009 


13.1205 


Teacher education: Secondary education and teaching 


051 


244 


244 


1010 


13.1201 


Teacher education: Adult and continuing education and teaching 


052 


245 


245 


1011 


13.1299 


Teacher education: Specific levels, other 


053 


250 


250 


1012 


13.13 


Teacher education: Specific subject areas 








11 




Engineering, engineering technologies/technicians 








1101 


14.05 


Biomedical/medical engineering 


058 


265 


265 


1102 


14.07 


Chemical engineering 


055 


262 


262 


1103 


14.08 


Civil engineering 








1104 


14.09 


Computer engineering 


056 


263 


263 


1105 


14.10 


Electrical, electronics, and communications engineering 




280 


280 


1106 


15 


Engineering technologies/technicians 








1107 


14.14 


Environmental/environmental health engineering 




264 


264 


1108 


14.19 


Mechanical engineering 


059 


270 


270 


1109 


14.99 


Engineering, other 


060-067 


291-300 


291-300 


12 


23 


English language and literature/letters 








1201 




English language and literature/letters 








13 


19 


Family and consumer sciences/human sciences 








1301 




Family and consumer sciences/human sciences 


068-077 


311-320 


311-320 


14 


16 


Foreign languages, literatures, and linguistics 








1401 




Foreign languages, literatures, and linguistics 








15 


51 


Health professions and related clinical sciences 








1501 


51.33 


Alternative and complementary medicine and medical systems 








1502 


51.01 


Chiropractic 


081 


334 


334 


1503 


51.10 


Clinical/medical laboratory science and allied professions 


078 


331 


331 


1504 


51.06 


Dental support services and allied professions 


078 


331 


331 


1505 


51.04 


Dentistry 


079 


332 


332 


1506 


51.07 


Health and medical administrative services 


080 


333 


333 


1507 


51.08 


Health and medical services/allied health 


078 


331 


331 


1508 


51.09 


Health and medical technicians/technologists 


078 


331 


331 


1509 


51.12 


Medicine, including psychiatry 


081 


334 


334 


1510 


51.15 


Mental and social health services and allied professions 


078 


331 


331 


1511 


51.16 


Nursing 


082 


335 


335 


1512 


51.17 


Optometry 


081 


334 


334 


1513 


51.19 


Osteopathic medicine/osteopathy 


081 


334 


334 


1514 


51.20 


Pharmacy, pharmaceutical sciences, and administration 


083 


336 


336 


1515 


51.21 


Podiatric medicine/podiatry 


081 


334 


334 


1516 


51.22 


Public health 


084 


337 


337 


1517 


51.23 


Rehabilitation and therapeutic professions 


085 


338 


338 


1518 


51.24 


Veterinary medicine 


086 


340 


340 


1519 


51.99 


Health professions and related clinical services, other 


089 


370 


370 


16 


22 


Legal professions and studies 








1601 


22.01 


Law 








1602 


22.03 


Legal support services 








1603 


22.99 


Legal professions and studies, other 


090 


380 


380 


17 


25 


Library science 








1701 




Library science 






390 


18 


27 


Mathematics and statistics 


101 


430 




1801 


27.01 


Mathematics 


101 


440 




1802 


27.05 


Statistics 


128-131 


641-644 


641-644 


19 


47 


Mechanical and repair technologies/technicians 








1901 




Mechanical and repair technologies/technicians 




460 




20 


30 


Multi/interdisciplinary studies 








2001 




Multi/interdisciplinary studies 


104 


470 


430 


21 


31 


Parks, recreation, leisure, and fitness studies 








2101 


31.01 


Parks, recreation and leisure studies 








2102 


31.05 


Health and physical education/fitness 
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Codes 




1988 


1993 


1999 


2004 


CIP 


Label 


132-137 


661-670 


661-670 


22 


48 


Precision production 








2201 




Precision production 








23 


12 


Personal and culinary services 








2301 


12.05 


Culinary arts and related services 


127 


630 


630 


2302 


12.99 


Personal and culinary services, other 








24 




Philosophy, religion, and theology 


105 


480 


440 


2401 


38.01 


Philosophy 


105 


480 


441 


2402 


38.02 


Religion/religious studies 


105 


490 


442 


2403 


39 


Theology 








25 


40 


Physical sciences 


092 


411 


411 


2501 


40.02 


Astronomy and astrophysics 


096 


414 


414 


2502 


40.04 


Atmospheric sciences and meteorology 


095 


412 


412 


2503 


40.05 


Chemistry 


096 


414 


414 


2504 


40.06 


Geological and earth sciences/geosciences 


097 


413 


413 


2505 


40.08 


Physics 


100 


420 


420 


2506 


40.99 


Physical sciences, other 


106 


510 


510 


26 


42 


Psychology 








2601 


42.17 


Behavioral psychology 








2602 


42.02 


Clinical psychology 








2603 


42.18 


Education/school psychology 








2604 


42.99 


Psychology, other 


108 


520 


520 


27 


44 


Public administration and social service professions 








2701 


44.04 


Public administration 








2702 


44.07 


Social work 








2703 


44.99 


Public administration and social service professions, other 




530 


530 


28 


41 


Science technologies/technicians 








2801 




Science technologies/technicians 


107 


500 


500 


29 


43 


Security and Protective services 








2901 


43.0102 


Corrections 








2902 


43.0104 


Criminal justice 








2903 


43.02 


Fire protection 








2904 


43.0107 


Police science 








2905 


43.99 


Security and protective services, other 








30 




Social sciences (except psychology), and history 


111 


542 


542 


3001 


45.02 


Anthropology 


112 


543 


543 


3002 


45.03 


Archeology 








3003 


45.04 


Criminology 


114 


545 


545 


3004 


45.05 


Demography and population studies 


115 


546 


546 


3005 


45.06 


Economics 


116 


547 


547 


3006 


45.07 


Geography and cartography 


117 


548 


548 


3007 


54.01 


Flistory 


118 


549 


549 


3008 


45.09 


International relations and affairs 


119 


550 


550 


3009 


45.10 


Political science and government 


120 


551 


551 


3010 


45.11 


Sociology 


121 


560 


560 


3011 


45.12 


Urban studies/affairs 








3012 


45.99 


Social sciences, other (except psychology) 


138-141 


681-690 


681-690 


31 


49 


Transportation and materials moving 








3101 




Transportation and materials moving 


888 


900 


900 


32 


99.99 


Other 








3201 




Other 
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2004 National Study of Postsecondary Faculty 

(NSOPF:2004) 

Second Technical Review Panel Meeting 

September 8—9, 2003 
Washington, DC 

The meeting was held September 8—9, 2003, at the Westin Grand Hotel in 
Washington, DC. The following were in attendanee: Clifford Adelman, Lindsay Albert, Eugene 
Anderson, Janet Austin, Roger Baldwin, Samuel Bedinger, Ernst Benjamin, Ellen Bradbum, 
Margaret Cahalan, Eisa Carley-Baxter, C. Dennis Carroll, Susan Choy, James Chromy, Miehael 
Cohen, Valerie Conley, Jayme Curry-Tueker, T.R. Curtin, John Curtis, Elaine El-Khawas, 
Mansour Eahimi, Martin Einkelstein, Jon Euller, Mary Golladay, James Griffith, Brian Harris- 
Kojetin, Daniel Heffron, Gregory Hensehel, Rieardo Hernandez, Ruth Heuer, Marjorie Hinsdale- 
Shouse, Gary Hoaehlander, Eisa Hudson, Traey Hunt- White, Donna Jewell, Paula Knepper, 
Roslyn Korb, Brian Kuhr, John Lee, Edith MeArthur, Alexander P. MeCormiek, Miehael 
Nettles, Mary Ann O'Connor, James Palmer, Kent Phillippe, Kenneth Redd, John Rieeobono, 
Jaek Sehuster, Robert Toutkoushian, and Linda Zimbler. 

Introduction (Linda Zimbler) 

L. Zimbler weleomed everyone to the seeond 2004 National Study of Postseeondary 
Eaeulty (NSOPE:04) TRP meeting. After brief TRP member introduetions, she outlined the 
purpose of the meeting: to diseuss the progress made on NSOPE:04, the plans for the full-seale 
NSOPE:04 study, and to solieit feedbaek on the faeulty questionnaire from TRP members. 

L. Zimbler reported that the National Center for Edueation Statisties (NCES) had 
released reports from the 1999 faeulty survey (NSOPE:99). In addition, tables are available on 
the web that were not ineluded in the printed reports. These reports ean be viewed from the 
NSOPE home page at: http://nees.ed.gov/survevs/nsopf 

L. Zimbler also mentioned that those using the data should periodieally eheek the “DAS 
updates” tab on the DAS web site for updates to variables that have been modified or added 
sinee the original files were released. She noted the new version of DAS is interaetive and user 
friendly. The DAS will be provided in print onee more and then will be available only online. A 
list of new or revised variables from NSOPE: 99 is available on the DAS web site 
http://nees.ed.gov/das/updates/ . 

Overview of field test questions (Maggie Cahalan) 

M. Cahalan provided an overview of the meeting goals: 

• to provide an update on major questions addressed and lessons learned in the 
NSOPE: 04 field test, and 

• to solieit input from the panelists for the full-seale study. 
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M. Cahalan briefly discussed the history of NSOPF and the challenges faced in prior 
NSOPF studies including; obtaining timely and complete lists; reconciling list counts with the 
Integrated Postsecondary Education Data System (IPEDS) data; the length of the faculty data 
collection period; obtaining lists and faculty response by sector (i.e., medical staff) and 
corresponding weighting issues; survey issues including the length and the applicability of the 
survey to a variety of faculty and instructional staff; and serving diverse users with competing 
interests. 

These prior issues, along with changing technology, have led to changes for the 2004 
NSOPE study, which include the founding of the National Study of Eaculty and Students 
(NSoEaS) (the union of the National Postsecondary Student Aid Study [NPSAS] and NSOPE); 
the elimination of the paper questionnaire with a movement to computer-assisted telephone 
interviewing (CATI) and self-administered web collection; the reduction in questionnaire length, 
while maintaining comparability to pervious items; and the reduction of time from the reference 
data to the release of data through means such as early institutional contacting (starting in 
March) and web incentives. 

M. Cahalan outlined the major questions posed for the NSOPE;04 field, which were 
addressed in subsequent sessions; 

• What would be the experience for NSOPE of uniting with NPSAS to form NSoEaS? 

• How would it work to eliminate the paper versions of the NSOPE instruments and 
have only web and CATI options? While eliminating the paper questionnaire would 
prevent people from seeing the length of the questionnaire, a potential concern was 
that some faculty members would not complete the questionnaire since the 
paper/pencil option was no longer available. 

• Can the data collection period be reduced without an increase in nonresponse bias? 

• What role can incentives play? A random assignment experiment was conducted 
during the field test to determine whether incentives help with nonresponse and if so, 
what amount is most effective in gaining respondent participation. 

• How would it work to use an integrated web/CATI instrument? 

• How did the changes to the survey instruments (i.e., shorten, simplify, add new items) 
work? 

• Can the time from reference date to release of data be reduced without reduction in 
quality? 

M. Cahalan briefly reviewed the NSoEaS schedule. The field test for NSOPE and 
NPSAS took place from fall 2002 through summer 2003. The NSoEaS early institution 
contacting began in March 2003. The full-scale list collection and faculty and student data 
collection will take place from fall 2003 through summer 2004. The data file and first E.D. Tab 
will be released in the winter of 2004. The statistical analysis reports for both NSOPE and 
NPSAS will be completed in the winter of 2005. 
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Field Test Sample Design (Mansour Fahimi) 

M. Fahimi provided an overview of the sample design for the NSOPF:04 field test. The 
full-scale study will survey 35,000 faculty and instructional staff at about 1,100 institutions in the 
50 states and the District of Columbia. The field test study sampled 1,200 faculty and 
instructional staff from 150 (remaining) institutions. 

Eligibility requirements for institutions for the NSOPF study include institutions located 
within the 50 states or District of Columbia and are classified as participating in Title IV student 
aid programs, including public or private not-for-profit, and 2-year or 4-year degree granting 
institutions. The institutions must offer educational programs designed for students beyond high 
school and be academically, occupationally, or vocationally oriented. Institutions that are not 
Title IV eligible; not degree granting; less than 2-year; for-profit; serve only secondary students; 
provide only vocational, recreational, basic adult education or remedial courses; provide only in- 
house courses/training or seminars of relatively short duration; or are U.S. service academies are 
not eligible. 

Eligibility requirements for faculty and instructional staff include faculty who are 
considered permanent, temporary, adjunct, visiting, acting, on sabbatical leave or postdoctoral 
appointees; employed full- or part-time by the institution; teach credit or noncredit classes; 
tenured, nontenured but on tenure track, or nontenured and not on tenure track; and interact with 
first-professional, graduate, or undergraduate students. Ineligible faculty or instructional staff 
include graduate or undergraduate teaching or research assistants; those with instructional duties 
outside the United States; those on leave without pay; those not paid by the institution (i.e., 
military or religious order); or those supplied by independent contractors or those who volunteer 
their services (i.e., volunteer medical staff). 

M. Eahimi provided a distribution of the universe of institutions and an allocation of the 
full-scale and field test samples of institutions by the 10 institutional strata. In addition, he 
presented tables that summarized response rates at the institution and faculty levels for the field 
test. 

Institutional Contacting Results (Brian Kuhr) 

There were a number of key changes in institutional contacting procedures for 
NSOPE:04. B. Kuhr reported that all institutions sampled for the NSOPE;04 study were also 
sampled for the NPSAS:04 study. However, institutions that were sampled for the full-scale 
study were excluded from the sampling frame of the field test study to reduce burden. The 
institution component has moved towards being “web only.” Eor instance, the institution 
questionnaire and related documentation (designation of coordinator and list documentation 
forms) could only be completed over the web. 

Eor the full-scale study, 12 states will be part of a “NPSAS oversample” that will allow 
NCES to provide them with student data that is representative at the state level. (Note: faculty 
data will not be representative at the state level.) These states include: California, Connecticut, 
Delaware, Georgia, Illinois, Indiana, Minnesota, Nebraska, New York, Oregon, Tennessee, and 
Texas. In return, these states are proving strategic support for both components of NSoEaS by 
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encouraging overall participation and assisting institutions within their state systems in providing 
data. Some states (Georgia and New York) have already agreed to provide some or all of the 
requested data at a system level. 

B. Kuhr presented tables showing the field test response rates for faculty lists and 
institution questionnaires by sector of the institution, as well as a chart comparing participation 
with prior NSOPF cycles. Overall, field test lists were received from 90 percent of NSOPF field 
test institutions, and 76 percent of field test sample institutions completed the institution 
questionnaire. 

In order to facilitate identification and resolution of problems prior to data collection, 
early institutional contacting for the full-scale study (to designate institutional coordinators) 
began in March. The early results of this effort indicate it has been successful: 93 percent of 
institutions designated a coordinator; 77 percent of institutional coordinators completed the 
Coordinator Response Form; and 12 percent of institutions are currently refusals at the Chief 
Administrator or Coordinator stage (compared with 27 percent during the field test). 

Field Test Data Collection (Marjorie Hinsdale and Lisa Carley- Baxter) 

M. Hinsdale and L. Carley-Baxter provided an overview of the faculty field test data 
collection procedures, including methodological changes from the 1999 NSOPF study; a 
summary of the field test schedule; and locating activities, results, and lessons learned from the 
field test. 

One methodological change from the previous cycle of NSOPF (NSOPF:99) had to do 
with data collection mode. For NSOPF:04, the paper version of the questionnaire (the most 
frequently used mode in 1999) was eliminated, leaving sample members with the option of 
completing the interview through CATI or self-administered on the web. 

M. Hinsdale demonstrated the faculty web site. The web site provided the means for 
sample members to access the questionnaire and included information about the study such as 
sample selection, sponsor and contractor information, and confidentiality assurances. In addition 
to the information provided directly through the site, links were provided to other relevant sites. 

M. Hinsdale reviewed the field test timeline and procedures used during the field test. 
After faculty lists were obtained from sampled institutions, all 1 ,224 cases were sent to batch 
tracing prior to the start of data collection to confirm accuracy of the addresses or to locate 
individuals with no address identified. Cases with telephone numbers were loaded into the CATI 
system with the most current contact information listed first. Cases with no telephone number 
(n=223) were sent to the Tracing Operations (TOPS) unit for intensive tracing. Once the cases 
were available to CATI, telephone interviewers attempted to interview the sample member. 

Cases that initially refused to participate were handled by interviewers specially trained in 
refusal conversion. 

M. Hinsdale reported that the information provided by institutions was generally 
accurate. The most difficult sample members to locate were part-time faculty and instructional 
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staff. Overall, 86 percent of the cases were located by TOPS. Of the 31 not located by TOPS, 

13 were completed by calling in or completing the web interview in response to letters mailed. 

L. Carley-Baxter reported the field test data collection results. Of the 1,224 sample cases, 
1,096 (90 percent) cases were contacted, 27 (2 percent) were ineligible, and 101 (8 percent) were 
not contacted. Of the 1,197 eligible sample members, 914 completed an interview for a 76 
percent response rate by the end of the field test period — February 1-June 30. Of the 914 
completed interviews, 908 were full interviews and 6 were partial interviews (i.e., completed 
through the end of section C [Q51]). Sixty-one percent (n=559) of respondents completed over 
the web, and the remaining 39 percent (n=355) completed over the telephone. Thirteen percent 
of web respondents called the help desk for assistance. Help desk interviewers recorded each 
help desk incident that occurred during data collection. A total of 225 incidents were recorded in 
the help desk application. Common reasons for calling the help desk included questions about 
the study, requests for study ID/password, and problems with computer/browser settings. 

Data collection recommendations for the full-scale study included prompts similar to 
those used during the field test: sending a reminder halfway through the early-response incentive 
period followed by another prompt approximately 3 days before the end of the incentive period; 
sending nonresponse follow-up letters throughout the data collection period; and offering early 
and nonresponse incentives. Recommendations for improvements to locating procedures 
included sending cases with only a school address to the tracing unit upon receipt of the faculty 
list rather than waiting for all lists to come in from schools; sending cases with missing key 
information (i.e., telephone numbers) to the tracing unit early in the data collection period; and 
grouping cases from each institution for more efficient tracing efforts. 

Incentive Experiment Results (Mansour Fahimi) 

M. Fahimi provided a detailed description of the incentive experiment, which included a 
summary of the analytical objectives of the field test, as well as its design and operational details. 
Respondents given the $30 incentive completed the survey by web in the early web response 
period at a rate almost twice that of those not given an incentive offer (34 percent completed 
compared with 16 percent). Respondents offered a $20 incentive had a 31 percent response in 
the early response period. 

Additionally, summary results were provided for testing the efficacy of incentives with 
respect to the hypotheses in question. The following are the main lessons learned from thi s 
experiment: 

1 . Incentives significantly boost the response rate during the first phase of data 
collection, resulting in 

• time/cost savings by securing more early interviews, and 

• cost/quality improvements by having more web-based interviews. 

2. Incentives significantly increase the completion rate during the CATI nonresponse 
follow-up phase, resulting in 

• improving the rate of refusal conversion. 
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Mock interview (Lisa Carley-Baxter and Marjorie Hinsdale) 

L. Carley-Baxter and M. Hinsdale demonstrated a moek faculty interview to remind TRP 
members of the content and length of the field test interview. The interview, including the 
informed consent information, took approximately 38 minutes to complete. Actual field test 
interviews typically took longer (average time of 42 minutes) due to transit time (i.e., the time it 
takes to transmit data to the server, for the server to store the data and assemble the next page, 
and for the page to be transmitted and loaded on the computer). 

Instrumentation (TR Curtin, Ruth Heuer, and Ellen Bradburn) 

T. Curtin reviewed the goals for NSOPF:04 instrumentation, which included housing all 
instruments on the web, shortening the instrument, creating an instrument that is easier to 
complete and results in higher quality data, and maintaining comparability with previous NSOPF 
studies. 

These goals were realized for the institution questionnaire in the field test. One hundred 
percent of completed interviews were electronic, with a majority of completes by web. The 
instrument was shorter (six items were deleted and the matrix item was greatly simplified) with 
an average time of 27 minutes compared to 90 minutes for web respondents in 1999. The 
instrument was more efficient since hardcopy data entry was not required, which allowed data 
processing to be done immediately. In addition, the skip patterns and routing of the instrument 
reduced the likelihood of answer resolution. Onscreen help and real time onscreen error 
checking (i.e., inconsistent data resolution) further improved data quality. Rates of missing data 
were very low, generally 1 to 2 percent after the implied “no” responses were addressed during 
data cleaning. 

R. Heuer reported that about 20 percent of institutions provided feedback on the 
institution questionnaire. Of those, 29 percent commented on the length of interview (e.g., 
load/transit time concerns and problems accessing the web), 45 percent gave instrument specific 
comments (e.g., wanted comment boxes on each screen, had concerns with academic year 
definitions, concern that definition of faculty wasn’t the same as that used in IPEDS), and the 
rest of the comments were platitudes and irrelevancies. 

T. Curtin mentioned that TRP members were sent a draft of the institution instrument 
about a month ago for comments. Those comments, along with comments received from field 
test respondents, were incorporated into the full-scale instrument. The two main changes to the 
full-scale instrument are the following: 

• I-la and I-lb. The first two items in the instrument ask the respondent to provide a 
“headcount” of full- and part-time faculty and instructional staff employed by the 
institution on November 1, 2003. For the field test, these two items were considered 
absolutely critical, and respondents were not allowed to skip these questions and 
complete the rest of the interview. (With a hard copy instrument, respondents could 
turn the page and complete the remaining form.) For the full-scale instrument, the 
respondents who do not have the full-time and part-time faculty counts will be asked 
the proxy questions “did you have full-time faculty and instructional staff’ and “did 
you have part-time faculty and instructional staff,” which will determine routing 
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patterns for the instrument and allow respondents to complete the rest of the 
questionnaire. However, respondents will not be able to lock and transmit the 
questionnaire until the counts in I- la and I- lb are entered. 

• I-IO and I-ll. These items about full-time employee benefits will be expanded in the 
full-scale study. For question I- 10, respondents will be asked if their institution 
provides employee benefits to all, some, or none of the full-time faculty or 
instructional staff at their institution. In addition, more benefit items will be added to 
directly model the longer list of benefits that was used in question I-15a. The 
response options for question I-ll were also changed to provide more information. 

R. Heuer reported on the faculty questionnaire findings. The faculty instrument consisted 
of eight sections surrounded by a front end that included informed consent and sample member 
identification and a back end that collected mailing information for incentives. The instrument 
was shortened somewhat and matrix items were simplified from the 1999 questionnaire. A 30- 
minute interview was proposed for the field test, but the average time to complete was 42 
minutes, including informed consent and other information. However, this was still less than the 
interview in 1999 (55 minutes). 

Numerous measures were taken to assess data quality: CATI interviews were monitored; 
help desk staff and interviewers were debriefed during and after the study; a reliability 
reinterview was conducted; and missing data was examined as were break offs, online help 
accesses, and respondent feedback. 

A subsample of respondents was reinterviewed using a subset of 26 items to assess 
reliability. Items selected for the reinterview were either new or had changed from the previous 
NSOPF cycles and were factual in nature. Overall, reliability was quite good. 

Of the 959 sample members who started the interview, 20 were deemed ineligible, and 31 
(3 percent) broke off. Of the 3 1 respondents who broke off, 6 did so in the employment section 
(A), 5 in the academic section (B), 14 in the workload section (C), and 6 in the scholarly 
activities section (D). Respondents who broke off after completing the workload section (C) 
were considered partial completes. 

High rates of help text hits for a particular screen typically indicate problems with the 
question (i.e., respondents asked questions about the meaning of a question or how to 
categorize). Within the faculty questionnaire, 10 screens (out of a total of about 80) had rates 
higher than 10 percent for help text hits, and 1 1 items (out of a total of 353) had missing rates 
greater than 10 percent. 

Overall, the assessment of the field test instrument revealed very few problems other than 
the length of the interview. 
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Faculty interview (T. Curtin and E. Bradburn) 

Prior to the meeting, NSOPF project staff met with NCES to review field test results with 
regard to each item on the faculty instrument. The review included consideration of item 
timings, reinterview results, interviewers debriefing comments, observations from monitoring 
interviews by project staff and NCES, and a review of whether and how the item was used in 
previous NSOPE analyses and reports. Based on these factors, a summary matrix was 
constructed, listing suggested revisions and preliminary recommendation for item deletions. T. 
Curtin and E. Bradburn facilitated the review of the faculty interview summarizing the 
recommendations listed in the matrix at the start of consideration of each item. A summary of 
the discussion follows. 

General comments: 

Panelists suggested shortening stem wording where possible. Panelists suggested finding 
a way to reduce the repetitive references to target school (especially if respondent has no other 
job) and reference period (if this can be done without causing confusion). It was also suggested 
that excess information be moved off the screen and into the help text to reduce time, where 
possible. 

Panelists, concerned about losing substantive data in the quest for a 30-minute interview, 
suggested changing the structure of the interview in future cycles in one of two ways: 

• split the sample in half and ask some detailed modules (e.g., scholarly activities) of 
half the sample and other detailed modules of the other half of the sample; or 

• create modules that are rotated in and out of NSOPE cycles (e.g., scholarly activities 
would be asked in one cycle but not the next). 

Panelists requested that a list be kept of items that have been/are being deleted for future 
reference. 

Introduction/Informed Consent 

A panelist suggested changing the reference from “postsecondary institutions” to 
“colleges and universities.” 

Section A: Nature of Employment 

Question 1. T. Curtin pointed out that this question is used in conjunction with question 
3 to determine sample member eligibility. V. Conley remarked that the question wording was 
lengthy and suggested putting the examples in parentheses or moving into the help text. T. 
Curtin pointed out that all sample members (CATI and web) need to receive this wording 
(interviewers do not read the text in parentheses to respondents but web respondents would read 
it). B. Kuhr responded that sample members may ask more questions resulting in an even longer 
interview. 
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Question 3. T. Curtin explained that some part-time staff were unelear what “faeulty 
status” ineluded. He suggested ehanging the question wording to: “During the 2003 Fall Term, 
did you have faeulty status as defined by [institution name]?” 

Question 4. Projeet staff reeommended ehanging the wording to: “Was your prineipal 
aetivity at [institution name] during the 2003 Fall Term...” 

Question 7. This was a new item in the field test that was suggested for deletion for the 
full seale. 

Question 10. Projeet staff reeommended ehanging the wording to: “During the 2003 
Fall Term, was your aeademie rank, title, or position at [institution name]?” 

E. El-Khawas asked if emeritus faeulty eould be added as a separate response option 
(apart from the “other” eategory). E. Zimbler mentioned that a question regarding retirement 
from another position is already in the interview. There was further diseussion of whether there 
is enough in the “other” eategory to split out anything else (e.g., adjunet). Curtis responded that 
the term “adjunef ’ is often used ineonsistently at different institutions and, therefore, eould eause 
eonfusion. 

Question 12. Projeet staff reeommended ehanging the wording to: “During the 2003 Pall 
Term at [institution name] were you. . .” 

Question 15. T. Curtin pointed out the need for a “don’t know” response option sinee 
there was a high rate of missing data suggesting that part-time and adjunet faeulty members were 
often unsure whether unions were available at their institutions. 

Questions 16VS/16CD. Panelists were eoneerned with the amount of time used for 
eoding and suggested various means to reduee time. A. MeCormiek suggested eheeking the 
verbatim string with the CIP eodes to find exaet matehes (e.g., soeiology) — if sueeessful, bring 
up eonfirmation box; if unsueeessful, eode (as in field test) with drop-down boxes. E. Anderson 
suggested a link between the verbatim response and the first eoding drop-down box, if this does 
not provide a mateh, then a box would appear direeting the respondent to re-eode his or her 
answer. J. Puller suggested putting the drop-down eoding boxes first and then eolleet verbatim 
string (to be eoded later), only if the respondent eould not eode their field. S. Bedinger 
suggested preloading the respondent’s department to aid in field-of-teaehing eoding. 

Section B: Academic/Professional Background 

Question 1 7A1. Project staff recommended collecting all degrees earned by the 
respondent and asking follow-up questions for the degree we consider to be the highest degree. 
This was suggested to eliminate the issue of which degree the respondent considers to be his or 
her highest degree. This would eliminate question 17B and the set of 17C questions. 
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One panelist pointed out that asking the level of institution for a sehool not found in 
IPEDS (as was done in the moek) is a waste of time for higher degrees (i.e., ean impute that it is 
a 4-year eollege or university). 

Question 1 7D1/1 7D2. Reeommend for deletion. E. Benjamin is eoneerned about the 
deletion of year baehelor’s degree was awarded (Q17D1) sinee this data provides information on 
nontraditional students as well as elapsed time between degrees. S. Bedinger mentioned that 
sehool information (Q17D2) also provides information on mobility/migration. 

Question 18. Projeet staff reeommended ehanging the wording to: “While you were 
employed at [institution name], how many other jobs did you hold during the 2003 Pall Term? 
Please do not eonsider outside eonsulting jobs. If none, seleet “0”.” 

Question 19 A. Projeet staff reeommended ehanging the wording to: “Were you 
employed full-time at any of these other jobs?” 

Question 19B. Projeet staff reeommended ehanging the wording to: “Did any of these 
other jobs involve instruetion at another postseeondary institution?” E. Benjamin suggested 
eolleeting the number of jobs, “How many of these other jobs involve instruetion at another 
postseeondary institution?” He mentioned the issue of “freeway fliers” (faeulty members who 
teaeh elasses at multiple institutions). 

Question 19C. This item was suggested for deletion. J. Curtis pointed out that by 
deleting this item, we lose data eoneerning whether a part-time faeulty member has another full- 
time teaehing job at another postseeondary institution. 

Question 20. Suggested for deletion. Panelists argued that this question is important 
sinee it eolleets information regarding the other work that part-time or adjunet faeulty members 
perform in relation to the eourses they teaeh. This is espeeially important for olinieal or 
teohnieal respondents who work part-time as instruetional staff (i.e., nurse who teaehes nursing 
elasses or a dentist who teaehes at the dental sehool). Possible questions that eould be 
researehed inelude why are these staff members working part-time (e.g., eould they not get a 
full-time teaehing job?)? E. Zimbler is eoneerned about the problems with standard error sinee 
the number of oases is small. 

The deoision was made to put this question on the ranking list for deletion. 

Question 22. Suggested for deletion. 

Question 25. Suggested for deletion. 

Question 26. Projeet staff reeommended ehanging the wording to: “When you first 
started working at your first faeulty or instruetional staff job at a postseeondary institution, were 
you...” 
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Question 28. Project staff recommended simplifying the response options: (1) 4- or 2- 
year postsecondary institution, (2) other educational institution, (3) government (federal, state, 
local) or military organization, (4) foundation or other nonprofit organization, (5) for-profit 
business or industry, and (6) other. E. Anderson expressed concern over how part-time faculty 
members would answer this question if they just started their part-time teaching position and 
continue to work full-time. Panelists agreed that this question may be difficult for part-time 
faculty members, especially those with multiple jobs, to answer. E. Anderson suggested 
providing different question wording for part-time faculty members (e.g., “Now, we would like 
to know about the sector of your concurrent full time employment.”). In the event a respondent 
has other part-time jobs, they would provide information about the job they consider most 
important. D. Carroll indicated that this question could be misinterpreted and should be field 
tested before implementation. He advised deleting it. 

Question 29. Suggested for deletion. 

Question 30. Suggested for deletion. E. Bradburn pointed out that question 23 derives 
similar information (“In what year did you begin your first faculty or instructional staff position 
at a postsecondary institution?”), thus question 30 can be deleted. 

Section C: Institutional Responsibilities and Workload 

Question 31. Project staff recommended changing the wording to: “On average, how 
many hours per week did you spend at each of the following work activities during the 2003 Pall 
Term?” 



There was concern about the examples listed in the question, as different faculty 
members could have different contractual requirements for which they are paid, which may 
conflict with the examples provided (e.g., some faculty may not be paid for class preparation, 
whereas we include it as a paid activity in the interview). This led to the suggestion that paid and 
unpaid activities be combined into a single question. Panelists pointed out that once the two 
categories are combined, it is impossible to split back into separate categories; this also results in 
the loss of trend line information. 

The decision was made to leave paid and unpaid activities as separate categories. 

Question 32. T. Curtin suggested combining questions 32 and 33 on a single screen. 

The options for question 32 would then be (a) undergraduate instructional activities, (b) graduate 
instructional activities, (c) research activities, and (d) other activities. Panelists believed 
respondents were thinking about work at the target institution, but the questions ask about all 
work. They suggested asking just about work in connection with the target institution. While 
this change removed the possibility for trend data, the decision was made to ask only about the 
job at the target institution. 

Question 34. Recommended for deletion. J. Curtis expressed concern over losing the 
distinction between service and administration activities. 
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Question 35A. T. Curtin suggested removing the instruetion on how to eount elasses 
sinee no one needed the additional instruetions to answer the question. 

Question 35B. T. Curtin suggested removing the phrase “or developmental” and 
eombining this question on sereen with 35C. R. Hernandez indieated that the term “remedial” 
needs to be defined. J. Curtis remarked that the term “developmental” is used by eommunity 
eolleges. L. Hudson suggested asking the number of elasses without distinguishing between 
eredit and noneredit elasses beeause of problems distinguishing between eredit and noneredit 
remedial elasses. 

Question 35C. Combine with question 35B on one sereen. The deeision was made to 
drop the distinetion between noneredit/eredit distanee edueation elasses so questions 35B and 
35C eould be eombined onto one sereen. 

Question 37. Projeet staff reeommended format, wording, and logie ehanges. D. Carroll 
suggested limiting the number to five elasses. E. Benjamin suggested limiting the number to six 
elasses sinee some eolleges eonsider six eourses overload. R. Toutkoushian asked if an item 
eould be added that asks about team teaehing. M. Finkelstein asked why it was useful to split the 
teaehing hours per elass. L. Zimbler responded that the split was needed in order to see a 
differenee between graduate and undergraduate teaehing hours. 

Question 38. Projeet staff reeommended moving item “a” after item “h,” due to 
eonfusion about what was meant by “student evaluations of eaeh other’s work.” A. MeCormiek 
suggested dropping the phrase “for student evaluation” from the question wording. 

Question 40. Projeet staff reeommended ehanging the wording of item f: “To provide 
assignments and practiee exams.” E. Benjamin suggested asking only whether the faeulty 
member has a web site (question 39) and dropping this follow-up question. 

Question 41. J. Palmer questioned whether this question was needed. E. Benjamin 
responded that this question deals with the issue of distanee edueation and how often students 
and faeulty eommunieate through eleetronie mail. 

Question 43. This question is suggested for deletion sinee eategories are not elearly 
understood by respondents. R. Hernandez argued that this question is essential to understanding 
the aetivities of faeulty at eommunity eollege level. A. MeCormiek remarked that this is the only 
question that eolleets information about faeulty members’ aetivities. E. Zimbler responded that 
this question should be eonsidered for deletion beeause respondents are taking a long time to 
answer the question (diffieult to grasp quiekly). R. Heuer suggested asking this as a yes/no or 
often/sometimes/never question. E. MeArthur suggested ehanging the time frame to mateh the 
rest of the instrument (fall term). 

Question 44. This question is reeommended for deletion sinee answers do not seem 
reliable. 
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Question 45. This question is recommended for deletion since respondents seem to guess 
at answers. 

Question 46. Project staff recommended changing the wording to: “Now for the 2003 
Fall Term, did you provide individual instruction for credit to any student at [institution name]?” 
L. Zimbler mentioned that this wording will add the notion that we are referring to individual 
instruction that is “for credit” (i.e., excluding time spent informally talking with students). R. 
Hernandez asked how faculty members will respond to this question if they teach noncredit 
individual instruction classes (e.g., remedial individual instruction may not be for credit). 
Panelists likewise expressed concern about faculty members in clinical or technical settings etc. 
whose individual instruction of students may not be considered for credit. J. Curtis suggested 
adding the wording about including interactions with students in a lab setting to the help text. 

Question 47 and 47B. Project staff recommended combining questions 47 and 47B on a 
single screen and adding skip logic based on level of instruction reported in question 32/33 (e.g., 
if a respondent reports 100 percent of their time is spent performing undergraduate instruction, 
question 47 would only ask about undergraduate students.) A. McCormick agreed this question 
should be modified to lessen the burden on respondents. The decision was made to look at the 
field test data to see if there is any discrepancy between questions 33 and 47. 

Question 50. Project staff recommended changing the wording to: “On average, how 
many hours per week during the 2003 Fall Term at [institution name] did you spend with 
students you were assigned to advise?” 

Question 51. Project staff recommended changing the wording to: “During the 2003 Fall 
Term, how many regularly scheduled office hours (either in person or online) did you have per 
week at [institution name]? (If none. . .)” 

Section D: Scholarly Activities 

Question 52A and 52B. Project staff recommended combining the questions 52A and 
52B on a single screen to collect career and 2-year totals for each category of publication and 
dropping the screens that collect career total using ranges. M. Finkelstein asked why both 
lifetime and 2-year scholarly activities are needed. R. Toutkoushian responded that is critical for 
his research on compensation. D. Carroll thought the matrix style question will take longer to 
complete. A. McCormick expressed concern about senior faculty members answering “don’t 
know.” D. Carroll responded that a very small number of respondents used the categorical 
ranges and agreed with dropping this from the instrument, coding their answers as “missing,” 
and imputing their answers later. He also suggested dropping the “other” category. E. El- 
Khawas suggested replacing the “other” category with a category for patents/ computer software. 

The decision was made to drop the categorical ranges. 

Question 53. Project staff recommended replacing this item with a gate question: “Do 
you have any scholarly activities such as research, proposal development, creative writing, or 
other creative works in the 2003-2004 academic year?” Those who do not would skip to the 
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start of the next section (question 61). E. Benjamin suggested the wording, “Do you have 
scholarly activities in an area other than your teaching field?” Some panelists asked if this item 
was needed. L. Zimbler responded that this item allows most faculty members to skip the coding 
of their research field (54VS/54VD). V. Conley suggested moving the gate before the 
publications matrix (question 52A/52B). 

Question 54VS/54CD. A. McCormick suggested asking this question only for those who 
did not provide a teaching field. E. Benjamin suggested dropping field of teaching and field of 
research question; instead ask everyone “What is your principal academic field?” 

Question 55. Project staff recommended changing the wording to “During the 2003 Eall 
Term, were you engaged in any funded scholarly activities. Do not include consulting services 
and research included as part of your basic salary.” R. Hernandez expressed concern about the 
time frame reference; asking about the fall term would be consistent with the rest of the 
questionnaire, but some faculty only do research over the summer. E. Benjamin suggested 
changing the time frame to the 2003 calendar year to cover faculty who perform research during 
the summer. J. Curtis suggested defining what scholarly activities include. 

Question 59. Project staff recommended changing the wording to: “How many grants, 
contracts, or institutional awards (beyond your basic salary) did you have from all sources in the 
2003-04 academic year?” A. McCormick suggested allowing zero as a response option. The 
decision was made to delete this item. 

Question 60A. Project staff recommended changing the wording to: “What was your 
total funding for grants, contracts, and institutional awards (beyond your basic salary) for the 
2003-04 academic year?” A. McCormick was concerned about the reference period since most 
individuals often only know the total grant amount (multi-year grants). J. Curtis suggested 
changing the question wording to, “Please only give an amount for [fill time frame].” D. Carroll 
recommended changing the wording to the total amount of the contract or grant (to cover multi- 
year contracts or grants). 

Question 60B. Project staff recommended changing the wording to: “The following 
ranges may make it easier for you to report the total funds you received for grants, contracts, and 
institutional awards (beyond your basic salary) for the 2003-04 academic year. Were your total 
funds received...” 

Section E: Job Satisfaction 

Question 61. Project staff recommended reversing the order of the response options and 
simplifying the question wording. D. Carroll suggested converting the scales to a yes/no format 
due to the likelihood of a mode effect (CATl respondents, because they do not see the scale, are 
less likely to use the “very satisfied” and “very dissatisfied” options). E. Benjamin would like to 
keep the question as is since question 61 A is the only indicator of how faculty members view 
their activities. 
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Question 62. T. Curtin pointed out the problem with item 62C. This item was missing 
for many part-time respondents, presumably because they do not have benefits from the target 
institution. E. Anderson suggested the wording change, “How satisfied are you with the benefits 
or lack of benefits you received?” A. McCormick thought time might be saved by splitting this 
question. L. Zimbler suggested keeping the question as is and rewording the question in the next 
field test. A. McCormick suggested changing the wording to, “How satisfied are you with the 
benefits available to you?” 

Question 63/64/65. Project staff recommended combining these three questions on a 
single screen, with questions 63 and 65 (which ask for expected age at retirement from all 
postsecondary employment and from all paid employment) adjacent to one another. M. 
Finkelstein asked if we needed questions 63 and 65 since this data is hypothetical. V. Conley 
responded that since the question about likelihood of retiring in 3 years has been deleted this is 
the only question that collects data about retirement age. J. Curtis mentioned these questions are 
used for trend data. 

Section F: Compensation 

Question 66A. Project staff recommended adding a confirmation box to provide the 
respondent with their total income upon exiting this screen. He also recommended changing the 
order of examples in question 66F to reflect the most frequently used categories (since 
interviewers tend to readjust the first few as examples). Panelists suggested listing self-owned 
business, speaking fees, and investment income first. A. McCormick suggested using the term 
“professional services” instead of “legaFmedicaFpsychological services” in item 66F. A panelist 
suggested having interviewers use the phrase “no individually identifiable information” when 
assuring confidentiality of the information. 

Question 67. Project staff recommended changing the wording to: “Is your basic salary 
at [institution name] during the current academic year based on a 9- or 10-month contract, an 1 1- 
or 12-month contract, or some other arrangement?” There was concern that CATI respondents 
may not catch the “other arrangement” option. 

The decision was made to add “course or credit hour” to the “other” response option. 

Question 68. Project staff recommended removal of the “specify” textbox for those who 
choose the “other” response. Panelists asked what kinds of “other” types of payment were 
reported by respondents. R. Heuer responded that “per student” and “per hour” were frequently 
reported. 

The decision was made that if a respondent answered “other” to question 68, they would 
skip question 69 and route to question 70 A. 

Question 70 A. Project staff recommended restating the income amount from question 66 
in the question wording: “You told us before that your income from all sources for the 2003 
Calendar year was $[Sum of Q66AA-Q66AF]. What was your total household income before 
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taxes for that same year?” Panelists found the onsereen definition of household ineome 
eonfusing and reeommended simplifying it. 

Section G: Sociodemographic Characteristics 

Question 76, E. McArthur noted the number of cases getting this item is small and 
suggested deleting it. D. Carroll responded that this item might be required to meet section 508. 

Question 77. Project staff recommended changing the wording to: “What best describes 
your marital or household status on November 1, 2003? Were you..” A. McCormick suggested 
not leading with single and never married. (Note: for this item, the order in the facsimile does 
not reflect the actual order used in the instrument. The correct order of the response options is 
(1) Married, (2) Living with partner or significant other, (3) Single and never married, and (4) 
Separated, divorced, or widowed.) Another panelist suggested taking out the “living with 
partner/significant other” response option. 

Question 78/79. Question 78 is suggested for deletion. D. Carroll suggested asking, 
“how many dependents were included on your tax form?” J. Curtis responded that it is important 
to distinguish between the number of dependent children and other dependents (e.g., parents). 

He suggested changing the question wording to, “How many dependent children do you have?” 
and follow up this question with “How many other dependents do you have? (Do not include 
yourself or your spouse.)” The decision was made to put question 78 on the ranking list for 
deletion. 

Questions 80/81. T. Curtin talked about combining questions 80 and 81 onto a single 
screen. Alternatively, assume those that are born in the United States are also United States 
citizens (i.e., use question 80 as a fdter for question 81). J. Schuster expressed an interest in 
collecting country of origin for those not bom in the United States, but others considered this a 
sensitive issue. 

Section H: Opinions 

Question 82. This question is suggested for deletion as data is available elsewhere. E. 
Benjamin argued that the race and gender variables are important for research purposes and that 
numerous variables within the interview can be used in conjunction with these items. Others 
advocated for keeping all parts of this question, as alternative data are not publicly available. 

Question 83. Some panelists suggested deleting this item since there is never any 
variance in responses. J. Schuster suggested that the item should be kept in, because in spite of 
faculty always complaining about their jobs, it is comforting to see that they would still choose 
an academic career again if they had it to do all over again. 

Question 84. P. Knepper suggested deleting this time-consuming item. Panelists agreed. 
The decision was made to delete this question. 



NSOPF:04 Field Test Methodology Report 



252 





Appendix G. TRP Meeting Summary 



Wrap-up (Linda Zimbler) 

As a last action at the TRP, attendees were asked to rank the questions being eonsidered 
for deletion. Subsequent to the meeting, these were tallied by projeet staff. 

L. Zimbler thanked panelists for their helpful eomments and informed them that the items 
ranked for deletion would be analyzed and the findings would be shared with the TRP by email. 
She briefly reviewed the sehedule for the full-seale study; In mid-September, binders will be 
mailed to the institutions that have agreed to partieipate in the study. In Oetober, the revised 
faeulty questionnaire would be sent to the Offiee of Management and Budget (0MB) for 
approval. Around mid-January, faeulty data eolleetion would begin. 
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